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ABSTRACT 

Tile purpose of this seminar, attended by 21 
participants, was to examine issues, problems, and components of 
models for the evaluation of occupational education. A primary 
objective was to stimulate interest in evaluation as an cjbject of 
research effort. Papers presented include: (1) "The Valud Structure 

of Society Toward Work" by Arthur R. Jones, Jr., (2) "Measurement and 
Appraisal of Competencies" by William R. Grieve, (3) "Evaluation of 
Occupational Education: Identification and Measurement of Student 
Output Variables" by Charles M. Armstrong, (4) "A Conceptual Model 
ror the Evaluation of Changes in Selected Personality Variables 
Through Occupational Education” by Joseph E- Champagne, and (5) 
"Program Planning and Evaluation" by Otto P. Legg. These papers 
served as a basis for small group discussions. (GEB) 
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PREFACE 



nrr , ^ im P° r f nCe of evaluation to the development o^ sound program* of 
occupational education is something that all of us in occupational education 
can agree upon. Particularly, since the financing of occupational education 
programs^must take into consideration the effectiveness of these programs it 
is incumbent upon personnel in occupational education to address their efforts 
1 ^ VS °perable evaluation techniques and methodologies. Despite the 

relatively high priority that has been placed on program evaluation K, 

the Division of Adult and Vocational Research in the Bureau of Research and* 
the Division of Vocational and Technical Education in the Bureau of Adult 
Vocational, and Library Programs, in the U. S. Office, of Education evaluation 

Education 311 by relativ ely few personnel in occupational 

ation. This seminar was convened for the purpose of attempting to increase 
committment to evaluation as an object of research. increase 

No great accomplishments can be claimed for the Seminar. No new theories 

intent ITT. ”* re . eV ° 1 '' ed • ”“ »«• new methodologies explicated. The 
intent wa. to examine issues and problems, and, in the small group discussions 

to examine the components of models for the evaluation of occupational educatik. 

. The C ® nCer extends its appreciation to all of the participants at -he 

£?amework n tr a di - ly ‘V 11 * consulCMts " h ° helped provide the common 

framework ior discussion. Specific recognition is due Dr. Alan Robertson 

irec or o Evaluation at the State University of New York at Albany w : o 

^Id e st!r l f SSearCh C °^ ittee ° n the Plannin S Committee, and Dr . 

T*‘h ld S n Ia’ SF?Clall - st 111 Evaluation from the Center for Vocational and 

Lcat^onil and^ 10 ^’- rh ? Un: '^ ersit y’ represented the Center ~ 

y°eciil tLnZi TeChniCaP Education on the Planning Committee. A note of 
_vp x 1 thanks is axsc due the technical and clerical staff of the Center 

thL report BdUMtl0n a3sist — the editing and preparation of 



tor 



John K. Coster 
Director 
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INTRODUCTION 



a“.s.? warns? 2 HS:=5=S:- 

of Education , and cooperatinq uni vers’fipc Thi !■ + e U- b ' 0fflce 
at Purdue University in 1963 an H III 1 The first seminar was held 
tion were held at the Unlver'itv n? rCl1 • Semi ^ a ^ s in vocational educa- 

versit'/ in 1964 T n 'Qfiq ■> c y ^ inois and Pennsylvania State Uni- 

the u„ivl« a s y les of four institutes was conducted bv 

4(c) “outlie 1 Vocati onal ^ducatfon .* ? ° f S ^°" 

that same year at the Univpr<;ifv/ n-p m i Other seminars were held 

Micnigan State University, and the Universi?; ofVwSlf® IndleT?' 

were *’? ^-^emi^ 966 ^ 

University of Illinois, Corne 11 Uni ve^si tv° NortlT"- ^ ° f G ?° r91a ' the 
si ty , and Colorado State Univer^itv rl y ’ N th urollna State Univer- 

The seminar being reported here wa'rcoiiducted^urinTTgel 1 ^ l967 ‘ 

sored jointly by the Cen+er for nr-ir n 2? 968 and was s P on “ 

State University at Ra?eiah hp°^ J w EdUC ? tl0n at North Carolina 
cation at The Ohio State MnivIJ 1 ^ TC T Vocatlonal and Technical Edu- 
American Vocational' Association Research Committee of^the 

niquer,'%nfp?ocedu?el 0 frTT, 0 teSt ! n9 ; and insta ”«^" of models, tech- 

sisv/css ^ 

ss mtcss 

ooth by the Division of Arliji t an n >- +. • t ? of Education, 

Research and by the Division nf w V catl0 [ ia ^ Research of the Bureau of 

Bureau of Adult, Vocational , and^l ibrary^frogram^^Yet^ ° f the 

not received the attontinr, „ c orary rrograms. Yet evaluation has 

mensurate with its significance^and^ 161 " 5 in £ c< j u P atl ’ ona ! education corn- 
area has not been fin ! concerted attack on the problem 

therefore, was to sh^a to the ? bj f cti ves of this Seminar, 

search effort. es1 " ln eva ^ u ation as an object of re- 



ial concern^ 1 Evaluation methodology ' presen^V^ncompasses 01 b P. re J s1n3 soc " 

ess ^^-0] v a e s e p ^^r r° 

tiiese methodologies, increased aftontin - 2 " P° «-en ti a 1 available in 
strategies through which the Pval^tiOn f.mrt? Cded to , the . dev e ] opment of 
gram development function Society ic inriI CtlC)n T ay ? e linl<Gd to the pro- 
evaluators. Investments in ocrminL ncreasing l y placing demands on 

recent years, and with the increase in 0ub?i“000!!di n^th ’ S6n ( $harply in 
questions qbout whether these invest^ ^hS^ 



an^socTal t sati sf action^an^the^wel fare^of^the 1 i nd^vi dual society . 

The problem area of evaluation may be subdivided into a number 
problems, which include the following: 

sTTccTi nctly stated and clearly defined ‘ 0 ^ r P ^ C ^ h SOciet al values 

objectives requires attention to the proces y evaluation of alter- 

and individual needs are translate at ^ d indiv idual welfare, 

nate goals and their probab.ee c PP rifi- obiectives to be attained, 

the cost of attaining the goals, the spec - 1 rte d to be modi- 

and the range of behaviors which may reason* ^ ^ 0 “ with the latter point, 
fied through occupational education. In conjunct on w . Qnal e duca- 

it seems logical to assume that specify P 9 which will enable the 

as* 

rk: zxszzr"™- ana thB 

decision making process in the choice of »n occupation. 

objectives and the development, te .* • ,9 obiectives have been attained. 

erenced instruments to ascertain whether wC occupational 

instruments are needed not, only designed to M . 



education, but also to evaluate the 
hance the decision-making process. 



3, tk p evaluation of outcomes of occu patlon.^^^ 

tion to instruments designed to eval u? ^ p pied° to P assess“outconies . Out- 
occuDati onal education, procedures are . n^oduc^s expressed in terms 
put is used here to refer to what the system P‘ ^on-referenced 
of how well the individual can P® r ^ instruments, is a predictive qual- 
measures - Output, as t^hov/wel ^ the individual performs on the job. Thus 
;h^ou?Sr?s r Srou^u; 0 ^:n^ by the system's external environment. 

which are related to 



In addi- 



The potential presence of confounding variables, 
me pjhci H sn H work environms 



the individual's personal, socia 



hounding var iduics, wni'-” “•*- . 

and work environment, mitigates against 

me mumuuu. .u e----- - - ’nacaav-rh id needed here to resolve the 

acrurate assessment of outcomes. Research is needed nere 

inherent difficulties in outcome evaluation. 

4. Strategies for es T ^ a ^ 5 evil ved VoV* ni"- 

^ - late b ° th 
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to program improvement (formative evaluation) and program effectiveness 
(sumniative evaluation). Thus far, limited attention has been given the 
design and development of strategies for information utilization.. Thus 
a fourth problem in the sequence pertains to the design and development 
of information utilization procedures which will direct the design and 
utilization of evaluation studies. 

The seminar did not address all of these problem areas. The first 
four papers dealt with (1) the value structure of society as a basis for 
the delineation of goals and objectives, (2) the measurement of competen- 
cies, \3j the evaluation of output variables, and (4) a rationale for the 
delineation of non-cognif i ve variables. The fifth paper presented an over- 
view of the significance of evaluation, These pacers served as a basis for 
the small group discussions, which in turn led to the identification of is- 
sues and the clarification of problems in evaluation. 

The seminar objectives were divided into two sets, substantive and 
operational objectives. These are listed below: 

Substantive Objectives 

1. To specify the behavioral outcomes which may be developed or 
changed through programs of occupational education, including vocational, 
technical, and practical arts education. 

. To speci ry strategi es , models, and designs which may be utilized 
in assessing the effects of occupational education on development and 
change as manifested in the previously identified behavioral outcomes. 

3. To design research programs directed toward the evaluation of 
products of occupational education expressed in terms of development and 
changes of behavioral outcomes. 

Op erational Objective s 

, ■ • To increase the number of researchers in occupational education 

wno are committed to conducting research which may be used as an input 
onto tne assessment of occupational education. 

2. To develop a framework for a concerted and coordinated attack on 
the broad problem of assessing the effectiveness of occupational education - 
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THE VALUE STRUCTURE OF SOCIETY TOWARD WORK 
INTRODUCTION 

In social intercourse people, ideas, 
in the sense of desirability. n t - course of action instead of 

anothe^suggests^ ^fundamental a ^ vcTli n d° o u ^ be ha vi o r 3 i s i p S T a r ge V p a r t 

di reeled toward Ihe' fttai nK°o^ arfreUvanHo 

over, the objects, whether they be peopl I things, ^ 1s „ ot 

our various social fields he q is a creature characterized 

indifferent or somehow emoti onal Jy ’-jgties and groups and the func- 

by his values. This i s the case _ i n a 1 'societies a ™ 9 s0(; V al order they 

tion: of the values ^Ise^f living il the context of some pattern 
may be attacned, In the co and 9 often situations which we must 

of social organization, -our act » , we hold. This is painful, 

be pa.rt of, are not consistent with the values we ^ they harmonize 

for our expectations of what is desi shrnent On a larger societal 

there is a sense of satisfaction and a f "consistent beyond a certain 

tolerable^evel 6 ^ tensions Sccur heralding the probability of 

some type of social disorganization. 

n-p thiQ naner is to relate certain values in American 
Tne purpose of this paper is institutions, education 

society to vtwCK of i-ts most ™strumen these questions: .-What are 

and work. Qrally, this objective fol ows ^e^questi what 

' the values antrwhpt I s the nature of for education? What is the rele- 

vance^of C these “cinsi derations 5 for the purposes- of evaluating vocational- 

technical education in the United States. 

/. 3+ 3 rr-itical time in the history of vocational- 

ihese questions appear at a critic n a arowth and expansion, 

technical education which is ex P er ^"Cing om DO i-jt-j ca l organizations and the 

and not infrequently appeal to be i nsol ubl e 9 probl ems . Increased 

lay public tolsolve what at times pp amount of service and ad- 

economic support and the resulting g nraa ni zational stress in many areas of 
ministration Lve created .burden of ftiU bind mgny prog- 

vocational programming. 01 d concep technological requirements 

rams which, in the context of ™pi d ly changing techno ogi ca I 

and labor market needs, reduce the impact of tne service u i 

technical systems. 

but may constitute significant ba of values for individuals and 

^ P r?™rc4 a r °ea of values i^-ng^ points^^the^act^ha^ 

llXt/Z socTal^ structure C Qccur^ ha Thi S P i s ; qui te significant allowing 
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. ,^ S pa . In short, approaching the last quarter of this century 

it 

able^soci a ^service!”* 16 9S*ls^f vocational -education into an even more St 

NATURE OF VALUES 

of the^vocabul ary U of l ^evel^of 1 soci ety^Tav and 6 C ° mm °? el ® ment 

it is hest HofinL ° or socl ety, lay and professional. Perhaos 

in so« sU^wSnf’ereni "r a Sb1e2?t’ ?h > refere " t1 *] interest" invested 

professional people.* although with'perhaps Tt th tdtreetf 

feS®®* 

s ^irss 

— QIQ§ Definitions and Dis ti notions 

apart Motive states 3 r! thlS ?? P fr we W1 attempt to keep these usages 
as are attitudes Vi,Ic essentially psychological in origin and function, 

ni fi^anfr^they S reside U fn the f^ia! and cuUurai in nature, although sig- 
ic ni a a ! G u resi ^ e ln the individual s cognitive structure That uihirh 

values n is h the C T n st- tU >- dl T ens ' ion which leads to difficulty in discussinq 
liams 'for P Lm f lnctlon between cultural values and social values. Wi?- 

by a group ? ^ If S -° f T Jt T ral Values as a11 values which are shared 

phA P cV i f l f bein9 shared in common constituting the maior cri- 

o°J group'wel fa're" 9 . 

tem^and tha't'the^ Wtfon^s^ruS^^o'rs ^soclTl’sys- 

is learned, acquired inV'procesforsocfar In^Son ,S deS,>able 

*A“w<!« «s s ^jsssarjswtK s.s:-s 
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personal or group conduct _A thl conductor verbally. 9 

cision making . normal ' ex "el 1 ent study on values in an organizational 
Scott defined value for hl ® defined as an individual's concept of 

context as a " ... moral ^ the 'goodness' or 'badness,' 

tt^Jlghtn^-’or 'wrongness,' of actual relationships that he observes 
or contemplates." 10 

According to Lundberg ' 

use of time and money.-, In a mucb ess orie ntation toward exper- 

Kluckhohn asserts that a value is a • which influences the or- 

ience, implying deep commi tment or repu in action." 12 They may 
denng of ’choices' between possible _ behavior. In a sociological 

be inferred from verbal as among the "stablest" and 

sense value-orientations have been ^scnbed ^ 9 ^ speaks of these 

"most enduring" of the elements ( J pm nhasizes their relative unalter- 
as the products of S0C1 al the basic core of 

ability in later yeare ; Value onenj rtions ^ ^ hap of 

^the H ^onian S eUsis n on val -orientation becomes dogma.- 



An important 
literature values 
overt behavior or 
from behavior . , . 
verbal profession 



taken. This is in contras . the behavioral position is simply 

behavioral..- A basic in ^®9uacy action with value, as in the case 

that it is not always possible to equate ^ io ns and the actual level 
of occupational status projection s , P ect general cultural values 

of occupational achievement. Asp ira occupational achievement (be- 

in -a society and are ^cessanly ^rtal^zed. n ^ c ^ sufficient test 0 f the 

havior ) at the level of one P occupa tional behavior may not neces- 
validity of aspirations, !•£. » one s o P personal and environ- 

K ^1l5 expressed. 

However, a reliance on verbal expressions ^determine ^^es^people 

hold is not without ^f^^^alements bj respondents in studies as truly 
extent to which we can accept s^eme ^^y n> .. Can we . . . take 

reflecting their real values, ■ . j_ ‘underlvinQ' values? 

people's statements and : reinterpret^ th( ^ ^ tio J t that verbal 9 statements 
Yes, provided we make the ques^ tl °" d b p rovi ded P we admit that the process of 
inevitably reflect real values, an P ampir ical controls and conse- 

cwmhnlir reinterpretation in itself nas no -ihiji . ,117 

quently may differ radically from one observer to another. 

ted definitions /^^va^ ^which'men' iden- 
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a "J ^ 100 5 e be J wee " al ternati ves\, These criteria may be conceived 
as standards, shared, but nevertheless varying accordinq to intra 
personal and interpersonal considerations. Values remain in th?ssen,p 

ation Ct or e v P ? en ° mena ' h A further im Portant distinction is’between evalu-’ 
ation, or valuing an object as merely pleasinq or desirahlp and rmit- 
or standards used to make the evaluation. The distinction % criteria 

Derived from the above considerations the definition of values Pm 
ployed in this paper is as follows. ^ Values are he t nLc ? hT 
men in asserting preference for objects or specific behaving d \/? d by 
here/defined as cultural inasmuch as they are shared ^ ^ 

o 1 c?!vfwl?? S ' nSOfa K r aS h ™ an ^ e ^ avl dr a and S interactIon^and S group e or° C " 

erenr has c ? nStruct ' need - “ h1ch has no empirical reP 

anTtte ana^^-s orb?o r socl : ar«uL%ini: Ch0 r n s lyt1C and P^sonSl ity theory/ 

S;«L b ^*n t l!SlriJ 0 7l th, h"” a h r ? , "'‘ t0 ’^ d ®ht1fy "an^mean i ngf u?ly 

s * r" *’ ^va?Sn7^:fd^ e ^o a„?"SaI?str f S^r- f 

standi ng man s occupational and educational motives and behavior 
Origins of Values 

a l ctinn eCa Thun V .n l,eS are shared they are Earned in the process of inter- 
the transferrence okthe^kkk^^ofk 6 ! ?f * he . 50c1ety contribute to 

course 11 ttT T" ^ ^efi^r'k^;;^ t f h r ?s are Tf 

with ns sociaT’ciasf w ?" d the agdncl ' es of formal education. Family 

nansferrence of oirenta? f 9 Tf Cant , fac i or at th1 s Point is the early 

°JK» e'tc 90 " 5 ]?" ^ su pksskdeo?ogy! C personal P worth 9 as^ related 
Uy iS trcnss e snu'nure varylng depend1n9 on the sod1a ' <* ‘he }am! 

pnmar?ly h o e fl!kk°cnia S ^tTadk]t eS T the ch,,d as a result 

forced or disturbed, new value! m y !! i2en?[ff" , for"'^ e f?rn y t- e re1 "~ 

the'^ocess'^'rL^He^ hf js^^chiSg.^S^ In' 

by which he identifies, eJplSres^ tries nSTn 3 ^- 9 n t0re ° f " standa rds" 
cupation out of several al ternati vp-T 2 2 °p t n ni flna J r 1 -y’ chooses one oc- 

wisely bis decisions in some way reject f^^^s^^^rh^h^kS^r" 

1? 



out of social interaction and which he shares with others who are part 
of his social and cultural frame of reference. It is this kind of or- 
ganization and direction of behavior that our construct, value, implies. 

As already noted by Parsons, the intensity with which value orientations 
are instilled early in life often results in only minor modifications in 
the value orientation of the person as an adult . 22 Thus basic orienta- 
tions toward work may follow a person through life with little change. 

Another major social source of values which is of considerable im- 
portance in a relatively open society such as our own is the mobility 
process itself and the concept of anticipatory socialization . According 
to Merton, in the mobility process individuals who aspire to enter groups 
or stratum in which they hold no membership develop the cultural patterns 
and values characteri sti c of the group with which they are identifying. 
Anticipatory socialization thus involves adopting the values of a. group 
to which one aspires with two resulting functions. It facilitates his 
inclusion into the group and fosters a more adequate adjustment follow- 
ing his acceptance . 23 

However, one of the insidious problems for the society in terms of 
anticipatory socialization lies in the generalized acceptance of cultural 
values related to achievement and success, particularly occupational achieve- 
ment. Many people in the lower reaches of the class structure are denied 
access to socially approved or legitimate means of achieving the success 
goals pointed to by cultural values. Therefore, in order to achieve social- 
ly approved and desirable goals, an individual will sometimes resort to il- 
legitimate or illegal means. Merton interprets much of the problem of crim- 
inal behavior in this fashion - 24 

The preceding discussion has already suggested the next major section 
of the paper, the relation of values to social stratification and through 
that, to much of man's work behavior. 

Values and Stratification 

A basic assumption for this paper is that human action is goal ori- 
ented , 25 In highly organized group life of today people participate in 
organizations or interact with others in order to achieve certain ends 
(guided by one's values). Goals range, of course, from simple friendship 
attraction to highly obligatory economic contracts. When behavior occurs 
it must be seen in relation ti many kinds of physical objects, people, 
ideas, and so forth, all of which .vary according to their basic instru- 
mentality in facilitating the goal attainment process. Standards emerge 
by which components can be judged according to their durability, utility, 
etc., and as Parsons notes " ... given the process of evaluation, the prob- 
ability is that it will serve to differentiate entities into a rank order 
of some kind ." 26 Rank ordering of components of action moreover serves to 
differentiate between positions in different social structures, each posi- 
tion being associated with various levels of reward — economic, honorific, 
or psychic. The combination of rewards for any position consti tutes ‘ i ts 
"value" and from that the prestige of the position . 27 
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stratum. A significant theoretical development given this condition is 
the emergence of a literature focusing on the alienation of modern man 
from society , 32 and especially his work- 

It is necessary at this point to look more closely at the structure 
of work in American society and its relation to values. 

VALUES IN THE U.S. TOWARD WORK 

For the purpose of this paper work is defined as activity related 
to the central problem of "making a living." The extreme division of 
labor and specialization and the fact of work being separated from place 
of residence clearly justify defining work pragmatically and operational- 
ly in this manner. Industrial and preindustrial societies differ marked- 
ly at this point as intimated above. In the latter type of social organi- 
zation work activities are not distinguished from other role functions and 
activities. In such societies " ... work tends to be an almost undiffer- 
entiated part of the routine of life, inseparable from religious ceremon- 
ial, the duties owed other members of an extended family, and what we would 
call play or leisure ." 33 In contemporary society man is clearly set apart 
from his traditional brother on this account. 

Major Values for Work and Occupational Orientation 

Given the open system of social stratification of American society, 
competition for rewards has flourished, and inherited reward and position 
has been minimized. In this kind of social milieu it is not unlikely that 
cultural values emphasizing personal achievement and success have devel- 
oped. 3 " Moreover, these values have become mixed with ideas of personal 
excellence. The implication of achievement is success which is interpreted 
in the personal equation as worthiness. Unfortunately , invidious compari- 
sons emerge wherein the less "successful," the downwardly mobile person 
"just doesn't rate up" to his achieving neighbor. The comparison is in- 
vidious because achievement values tend to result in compartmentalizing 
humans rather than seeing them holistically. The individual is not viewed 
as a who 1 e personality but as more or less successful in the area of his 
life circumscribed by work activity. 

Achievement values typically associate occupational success with high- 
er levels of income. As Williams states, "In a society of relatively high 
social mobility, in which position in the scale of social stratification 
basically depends upon occupational achievement, wealth is one of the few 
obvious signs of one's place in the hierarchy . " 35 

Another basic value espoused by Americans is represented in work it- 
self. "Disciplined activity in a regular occupation is a particular form 
of this basic orientation ." 36 This orientation is the curious result of a 
set of earlier rel i gious--now somewhat vesti gal --i nfl uences and the parti- 
cular rigorous requirements of the early history of settlement of the U. S. 
The protestant ethic which Max Weber called attention to 37 had to do with 
the association between religious ethics and work ethics as the former were 
gradually absorbed into the latter. In the Calvinistic period analyzed by 
Weber salvation and grace were exemplified in secular work activities in 



terms of a "doctrine, of works . 1,38 These ideas were part of the "trans- 
plant" of culture that occurred with immigration of Britains and Euro- 
peans to this country early in its history. Thus the value of work and 
associated activities reinforced by religious sanctions accompanied many 
of thr early settlers whose very existence and group survival depended 
on diligence and disciplined activity. There was no place for aristo- 
cratic traditions or disdain of manual labor in the wilderness. These 
conditions and requirements in conjunction with a wide range of untapped 
resources and later the developing system of commerce provide the stimu- 
lus for values emphasizing work activity, achievement and economic success. 

Prior to the period of rapid industrialization, especially after the 
Ci'-il War, there existed a kind of social order with underlying value prem- 
ises which Robert and Helen Lynd wrote about in their classic study. Mid- 
dletown , They reconstructed a picture- of Middletown prior to its indusTT 
trialization in which skilled crafts were on an equal par with the small 
middle-class businessman. Equality was on a political', social, and eco- 
nomic level and Lynd spoke of occasional envy of businessmen toward crafts- 
men in reference to desirable features of the craft mode of work organiza- 
tion. There was no highly exaggerated pattern of residential segregation 
and above all, perhaps, the craft organization provided a "career" for its 
people in terms of movement through the apprentice and journey levels to 
master. 

But the Lynds rioted that partially as a result of industrialization 
change was wrought in the system of stratification and in the associated 
values in a relatively short period of time. What they observed in Middle- 
town was the beginning of a process of organization that emphasized bureaj- 
cratization, hierarchial patterns of authority, new income differential fir 
managers and workers, new skill requirements due to technological innova- 
tion, a decline in craft organization, increasing residential segregation 
between workers and those in business, worker adoption of consumer values, 
and the pushing of their offspring to higher educational attainment in or- 
der to secure better jobs .-" 3 As the social order became more and more 
specialized and differentiated, as manual labor lost its connection with 
the control of private property, and as differentials of wealth and power 
crystallized, manual work as such was devaluated . 40 

Concomitant with the devaluation of manual labor as expressed in the 
values of society there has been an increasing valuation of white-collar 
types of occupations, especially the professionals and management, and 
science and technology which are exploited and manipulated at the upper 
occupational levels. The professions and other white-collar positions 
are attractive and desirable because of income, prestige, level of auton- 
omy, and degree of "intrinsic" satisfaction with the occupation through 
the career line and over time. About science, Williams writes: 

Very broadly, emphasis on science in America has reflected 

the values of the rationalistic-individualistic tradition. 

Science is disciplined, rational, functional, active; it 




is congruent with the "means" emphasis of the culture -- 
the focus of interest upon pragmatism and efficiency and the 
tendency to minimize absolutes and ultimates, The applica- 
tions of science profusely reward the strivings for ... mas- 
tery of the environment. We think it fair to say that sci- 
ence is at root fully compatible with a culture orientation 
that attempts to deny frustration and refuses to accept the 
idea of a fundamentally unreasonable and capricious world. 41 

Values and Aspirations 

The values held for these occupations and for science constitute 
the criteria for making occupational status projections by many Americans, 
Patterns of aspiration generally reflect idealization of upper occupation- 
al strata regardless of the social class of the one aspiring, Di fferences 
in aspirations by social class are typically expressed in degree rather 
than kind. This is indicated ir. a current analysis of data on low-income 
populations in the Mississippi Delta being conducted by this writer. Negro 
household heads in the sample have low statuses, but aspire to upper blue- 
collar and 1 ower whi te-col 1 ar occupational statuses. They aspire for their 
sons to lower white-collar and upper white-collar statuses. However the" r 
stated expectations for their sons are for jobs very near the low statuses 
they (the household heads) currently occupy, 42 Similar findings are re- 
ported in reports on low-income southern populations based on a large 
cooperative research project, 43 In a relative sense, then, lower socio- 
economic populations are not unlike middle and higher socioeconomic popu- 
lations in stating thei r occupational preferences. 

Nevertheless there are structural variations in the values espoused 
for the higher occupations. Generally urban populations express occupa- 
tional aspirations at a higher level than do rural populations. 44 Rural 
youth do not have the same probabilities of experiencing many occupational 
alternatives as do their urban brothers. Hi stori cal ly , rural youth have 
tended to be drawn into the labor force (farm) at an earlier age than ur- 
ban youth, which is a limiting condition on the expectation to express 
serious aspirations beyond that point In addition, aspiration-achieve- 
ment values of rural youth are limited in other ways. 45 

Aspirations also vary according to social class 46 and on this basis 
according to education 47 also. Level of educational experience in the 
context employed here is generally influenced by class norms and oppor- 
tunities. Family influence has been found to be related to level of 
aspi ration , 48 

The fact that so large a percentage of blue-collar workers express 
a desire for white-collar types of work and that there is a transferrence 
of this value to their offspring calls attention to a question frequently 
asked, vi z . . Why is this the case? Why do some semi-skilled operatives 
and many skilled workers hold such values when often their own incomes 
presumably exceed those of white-collar workers and they, more frequently 
than white-collar workers, own their own homes? Might we reason as does 
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training are considerable. 

VALUES, WORK AND EDUCATION 

The role of education in understanding the value structure of socie- 
ty toward work cannot be overlooked. We begin with the assumption that 
in a given society or locale educat on will a ways e fie 

^^r4^:^hSir!l>r^sfgln^nepra^onal values lend to 
be diffused quite widely throughout the society. 

The, nrinrinle of stratification, extended into the school system, it- 
self functions as a limiting and selecting^factor Sm !■ 

dfl^and till iSplStfoSJ of this are cited by Hollingshead in his youth 
study. 59 He writes: 

From interviews and attendance at Board meetings It became clear 
that the question of cost was uppermost in their thoughts when 
ever a! innovation was suggested. The problem of cost versus 
educational values was particularly acute whenever the high 
school w™ involved. ... They believed that many boys an^ 
girls who were in high school would have been b ' 

the farm or at the Mill. No Board member was found who at any 
t me believed tSat it was the responsibility of the community 
^provide educational facilities for all hi gh school aged ado- 
i pc ren t s When it was suggested that the trauitional type 
high school education might not be the type needed for the lower 
classes the suggestion was countered usually with the argument 
that vocational 9 education cost too much per student to be put 
into effect on a broad scale; besides the boy and girl couid 
learn the same types of skill 'from life, 
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And similarly in their studies of adolescent character and person- 
ality-, Havighurst and Taba note: 

The moral values of the adolescent peer group culture are 
largely middle-class standards set by tne high school, 
which is, in turn, run by people with middle-class values. 

The teachers are nearly all mi ddle-cl ass and so are te 
parents who are most active in high school affairs. y> 
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the dominant: adolescent group in the high school 
posed mainly of middle-class boys and girls , 61 
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hold for different types of education has a number of- imp! i cati ons . The 
functions and dysfunctions of the prestige of organization have been sug- 
gested by Perrow. These include: explicit, unrealistic assessments of 

situations; unidirectional mobility pattern, usually upward; rewarding 
equal performance unequally; exaggerating the importance of the high pres- 
tige organization at the expense of the low prestige organi zation ; hamper- 
ing recruitment of competent and highly qualified personnel in low pres- 
tige organizations; and hampering maintenance of top level people in the 
organization, 67 , 

In this section we have tried to suggest (1) that the general strati- 
fication system of a given community, and through it, values, pervades the' 
organization and structure of education in the community; and (2) that val- , 
ues people hold toward education result in a popular ranking. The signifi- 1 
cance of this ordering can be seen in terms of organizational problems: 
personnel recruitment and maintenance, student selection and maintenance, 
distribution of economic resources, distribution of physical facilities, 
etc. Taken together we imply that as all the relevant variables fall into 
place we have an educational system structured somewhat variably from place 
to place, but nevertheless constituting more and more the essential mechan- 
ism in our society for effective movement into the world of work. Exposure 
to education helps to instill the basic value structure of a society for 
work, in the cultural orientation of the student. Moreover, the student 
envisions his own pidce, depending upon his social class, as it has been 
defined by society. 

SUMMARY AND IMPLICATIONS 

The value structure of society for work has developed in terms of two 
basic concepts, val ue and stratification. Value was defined as the stand- 
ards used by men in asserting preferences among alternatives. Values are 
shared, therefore are cultural, and are patterned. They may be inferred 
from either verbal expressions or overt behavior. Values are built into 
the social stratification system inasmuch as the system of strati fi cati or 
is a valuational phenomenon based on the institutionalized ranking of cer- 
tain items or characteri sti cs of populations. Occupational activity con- 
stitutes one of the primary indicators of social class and, therefore, dif- 
ferent kinds of work are variously valued depending on the soc il stratum 
to whfch it is primarily linked. 

Several dimensions of the value structure of work were explored. These 
included the idea of achievement and success, particularly as reflected in 
aspiration behavior and pccupati onal prestige ranking. Specific value ori- 
entations for work (helping people, opportunity for self expression and work 
for extrinsic income reward!) were reviewed. 

f ' 

I 

The value structure of a community pervades its educational institutions 
and constitutes a major social mechanism which further inculcates certain val- 
ues concerning work in most students. The extent of favorable competition in 
the world of work is in part a result of the location of one J ? relative posi- 
tion throughout his educational career in schools, and the location of the 



school itself in terms of generalized values which differentiate the 
various types of education of educational systems from each other. Thus, 
the rank order of the school is related to how it fares in dealing with 
routine but necessary organizational problems. The image of vocational - 
technical education will undoubtedly continue to change in response to 
other changes in the economic and labor market structures of society. 

Some implications of this discussion are as- follows: We would ex- 

pect values toward vocational -techni cal education to change because of 
the functional contribution sub-professional technicians are now making 
to the economy. Our scientific efforts and technological changes are fos- 
tering a greater need for skilled technicians who will not be trained in 
universities and colleges essentially but in specific vocational -techni cal 
programs. The need for, the economic rewards associated with, and the oc- 
cupational structure of technician level occupations should result in a 
significant increase in the aspirations and motive levels necessary to 
achieve that level of work experience. 

Secondly, the values, the criteria people use to choose work and in- 
fluence others' choices- of work should change in relation to the amount 
of recent and continuing exposure from political and economic sources on 
problems of mobilizing those in "poverty" and those who are unemployed 
or underempl oyed in American society. 

Third, advancing technological problems will require an increasing 
number of adults to reevaluate their present experiences in terms of the 
need for retraining. Adult education exposure should result in some re- 
organization of values for the requirements of both upper blue-collar anc 
for many white-collar occupations. All of the factors noted relate to the 
function that increased visibility and "product" marketabi 1 i ty have for 
vocational education. This increase in visibility and marketabi 1 i ty should 
be reflected in both quantity and quality of students moving into kinds cf 
work where cheir formal training is the result of participation in sub- 
baccalaureate occupational education-training programs. 

Finally, unless the choices made by political, economic, and educa- 
tional leaders result in action that mobilizes the employable out of the 
ranks of low-income cultural situations' (historical ly, efforts have been 
rationalized through social welfare programs of various sorts) it is most 
likely that the gap between the "haves" and "have-nots" in society will 
grow larger and more distinct. The employment requirements derived from 
sophisticated organizational and technological developments strictly bypc.ss 
those without requisite qualifications for entry and participation. 
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APPENDIX A 



Distribution of Employed Civilian Workers, by Occupational Groups and 
Selected Occupations, United States, 1950. 



Occupation Groups and Selected 
Occupati ons 


1950 

% 


1950 

% 


Percent 

Change 


Persons with occupations reported 


100.0 


100.0 




White-collar workers 


43.3 


37.4 


27.7 


Professional, technical & 


kindred workers 


11 .8 


8.8 


47.0 


Engineers, technical 0 


1 .4 


.9 


64.3 


Chemi cal 


.1 


.1 


26.1 


Ci vi 1 


.3 


.2 


24.0 


El ectri cal 


.3 


.2 


73.7 


Industri al 


.2 


1 


142.0 


Mechani cal 


.3 


[ 2 


40.7 


Sales 


.1 


(b) 


129.8 


Natural scientists 


.2 


.2 


27.7 


Biological scientists 


(b) 


(b) 


51 .2 


Chemi sts 


.1 


1 

n 1 


11.8 


Mathemati ci ans 


(b) 


(b) 


345.1 


Physicists 


(b) 


(b) 


8718 


Medical and other health workers 


2.1 


1 .8 


29.6 


Dentists 


.1 


.1 


10.2 


Dietitians & nutritionists 


(b) 


(b) 


15.2 


Nurses, student Drofessional & 


professi onal 


1 .0 




34.2 


Physicians & surgeons 


.4 




18.9 


Technicians, medical and dental 


..2 


.1 


80.2 


leachers, elementary & secondary 


school s 


2.5 


1 .8 


45.9 


Other Drofessional, technical & 


kindred workers 


5.5 


4.0 


52.3 


Accountants & auditor's 


.8 


.7 


24.7 


Lawyers & judges 


.3 


.3 


16.9 


Technicians, electrical & electronic 


.1 


(b) 


679.2 


Technicians, other engineering & 


physical science 


.3 


.2 


101 ,8 


Managers, officials, & proprietors 


except farm 


8.8 


9.0 


-7.4 


Salaried 


5.5 


4.5 


35.0 


Sel f-employed 


3.3 


4.5 


-20.0 


Clerical & kindred workers 


15.1 


12.5 


33.8 


Secretaries, stenographers & typists 0 


3.5 


2.7 


44.5 


Other clerical workers 


11 .6 


9.8 


30.9 


Cashiers 


.8 


.4 


102.7 


Office-machine operators 


.5 


.3 


116.2 
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V 



Occupation Groups and Selected 
Occupations 

Sales workers 
Retail trade 
Other than retail trade 
Insurance agents, brokers & 
underwriters 

, Real estate agents & brokers 
> Salesmen & sales clerks, manu- 
facturing 
Manual workers ' 

Craftsmen, fore'men, & 
kindred workers 
Foremen (not .elsewhere 
classified ) 0 
Construction craftsmen 0 
Bn ckmasons , stonemasons, & 
setters 
Carpenters 
Electricians 
Mechanics & repairmen 0 
Air-conditioning, heating & 
refrigeration equipment 
Automobiles 
Office machines 

Metal craftsmen, except mechanics d 
Boil ermakers 
Machinists 
Mol ders 

Toolmakers, diemakers & setters 
Other craftsmen 
Locomotive engineers 
Locomotive firemen 
Operatives & kindred workers 
Drivers & deliverymen 
Other operatives, etc. 

Laborers except farm & mine 
Service workers, including private household 
ervi ce workers, except private household 
Protective service workers 0 

Waiters, bartenders, cooks, and counter 
workers 

Other service workers 



1960 

% 



1950 

% 



Percent 

Change 



7.5 


i 7.0 


18.7 


4.4 


4.4 


10.0 


3.2 


' 2.6 


33.4 


.6 


.5 


33.7 


.3 


.3 


37.0 


.8 


.6 


41.7 


38.6 


40.3 


- ' 5.8 


14.2 


14.0 


11.8 


1 .8 


1 .4 


41 .1 


. 3.9 


4.2 


2.1 


-3 


.3 


12.0 


T *. 3 


1 .6 


- 10.9 


• 5 \ 


.6 


8.3 


3,6 1 


- 3.1 


28.6 


.1 


1 J 


42.1 


1.1 


\ 1.2 


4.2 


( b ) 


\ .1 


- 5.7 


1 .8 


i 2.0 


.4 


( b ) 


1.1 


- 33.4 


.8 


.9 


• - 3.1 


. 1 " 


.1 


- 19.4 


.3 


.3 


T 9. “4 ■ 


3.2 


3.4 


3.1 


.1 


.1 


- 22.4 


.1 


.1 


-31 .7 


19.4 


20.1 


6.4 


3.7 


3.4 


19.6 


15.7 


16.7 


3.7 


5.1 


6.2 


- 9.6 


11.7 


10.2 


25.6 


8.9 


7.7 


26.7 


1.1 


1,0 


17.3 


2.8 


2.4 


29.3 


5.0 


4.3 


27.5 
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Occupation Groups and Selected 
Occupations 



Private household workers 
Agricultural workers 

Farmers & farm managers 
Farm laborers & farm foremen 



1960 

% 



2.8 

6.4 

4.1 

2.4 



1950 

% 



2.4 

12.1 

7.7 

4.3 



Percent 

Change 



29.3 
-41 .3 
-41 .9 
-40.2 



a Adjusted to include Alaska and Hawaii. 

3 Less than 0.05 percent. recorded in this group are 

C Female only; . 

d Ha l" e C in?yt 1 the^f ew°women°recorded J i n this group are Included in the 

total for the major occupational group. ■ totals 



SOURCE: 



Employment) .^ 9 ^ (Member 1962 ). 

p.1211- 






APPENDIX B 



Distribution 



of NORC Prestige Ratings, United States, 1947 and 1963 



Occupati on 



U. S. Supreme Court Justice 
Physician 
Nuclear physicist 
Scientist 

Government scientist 
State Governor 

Cabinet member in the federal government 
College professor 

U- S. Representati ve in Congress 

Chemi st 

Lawyer 

Diplomat in the U, S, Foreign Service 

Dentist 

Architect 

County judge 

Psycho logi st 

Minister 

Member of the Board of Directors of 
a large corporation 
Mayor of a large city 
Priest 

Head of a department in a state 
government 
Civil engineer 
Airline pilot 
Banker 
Bio logi st 
Sociologist 

Instructor in public schools 
Captain in the regular army 
Accountant for a large business 
Public school teacher 

Owner of a factory that employs about 
100 people 
Building contractor 
Artist who paints pictures that are 
exhibited in galleries 
Musician in a symphony orchestra 
Author of novels 
Economist 

Official of an international labor union 
Rai 1 road engi neer 



1947 1 963 



% % 



1 


1 


2.5 


2 


18 


3.5 


8 


3.5 


10.5 


5.5 


2.5 


5.5 


4.5 


8 


8 


8 


8 


8 


18 


11 


18 


11 


4.5 


11 


18 


14 


18 


14 


13 


14 


22 


17.5 


13 


17.5 


18 


17.5 


6 


17.5 


18 


21 .5 


13 


21 .5 


23 


21 .5 


24.5 


21 .5 


10.5 


24.5 


29 


24.5 


26.5 


26 


34 


27.5 


31.5 


27.5 


29 


29.5 


36 


29.5 


26.5 


31 .5 


34 


31 .5 


24.5 


34.5 


29 


34.5 


31.5 


34.5 


34 


34.5 


40.5 


37 


37.5 


39 




36 



Appendix B (Continued) 



Occupati on 


.1947 

% 


1963 

% 


County agricultural agent 


37.5 


39 


Owner-operator of a printing shop 


42.5 


41.5 


Trai ned machi nist 


45 


41.5 


Farm owner & operator 


39 


44 


Undertaker 


47 


44 


Welfare worker for a city government 


45 


44 


Newspaper columnist 


42.5 


46 


Pol i ceman 


55 


47 


Reporter on a daily newspaper 


48 


48 


Radio announcer 


40.5 


49.5 


Bookkeeper 


51 .5 


49.5 


Tenant farmer 


51 .5 


51 5 


Insurance agent 


51.5 


51.5 


Carpenter 


58 


53 


Manager of a small store in a city 


49 


54.5 


A local official of a labor union 


62 


54.5 


Mail carrier 


57 


57 


Railroad conductor 


55 


57 


Traveling salesman for a wholesale concern 


51 .5 


57 


PI umber 


59.5 


59 


Automobile repairman 


59.5 


60 


Playground director 


55 


62.5 


Barber 


66 


62.5 


Machine operator in a factory 


64.5 


62.5 


Owner-operator of a lunch stand 


62 


62.5 


Corporal in the regular army 


64.5 


65.5 


Garage mechanic 


62 


65.5 


Truck driver 


71 


67 


Fisherman who owns his own boat 


68 


68 


Clerk in a store 


68 


70 


Milk route man 


71 


70 


Streetcar motorman 


68 


70 


Lumberjack- " " 


73 


72.5 


-Restaurant cook 


71 


72.5 


Singer in a nightclub 


74.5 


74 


Filling station attendant 


74.5 


75 


Dockworker 


81.5 


77.5 


Railroad section hand 


79.5 


77.5 


Night watchman 


81 .5 


77.5 


Coal miner 


77.5 


77.5 


Restaurant waiter 


79.5 


80.5 


Taxi driver 


77.5 


80.5 
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Appendix B (Continued 



Occupation 



1947 1963 

% % 



Farm hand 
Jani tor 
Bartender 

Clothes presser in a laundry 

Soda fountain clerk 

Sharecropper 

Garbage collector 

Street sweeper 

Shoe shiner 



76 


83 


85.5 


83 


85.5 


83 


83 


85 


84 


86 


87 


87 


88 


88 


89 


89 


90 


90 



SOURCE: Robert VJ. Hodge, Paul M. Siegel, and Peter H. Rossi, "Occupation- 

al Prestige in the United States, 1925-1963," American Journal of_ 
Sociol og.y , LXX (November 1964), 290-292. 
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MEASUREMENT AND APPRAISAL OF COMPETENCIES 

I am grateful for the opportunity to present this position paper at 
The National Seminar on Research in Occupational Education at the North 
Carolina State University and to express some ideas about evaluation and 
particularly about the measurement and appraisal of competencies in oc- 
cupational education. Because it seems to me that the measurement and 
appraisal of competencies is basic to the planning of our entire education- 
al program and to the progress of the industrial and social growth of our 
Nation, my first reaction upon receiving the invitation to present a posi- 
tion paper was to prepare a detailed analysis and interpretation of what 
might and should be done in this area of occupational education research. 
This would have included information bas'c to all research and the statis- 
tical treatment of data rather than a consideration of competencies that 
should be striven for on various educational levels and in preparation for 
success in employment. Because information on research techniques is read- 
ily available ar.d those engaged in research are well informed my second 
thought was to point up some of my reaction^ to experimentation in the 
area of measurement and appraisal of competencies rather than to discuss 
techniques or methodology. 

Introduction 



It is the i.-’Tpose of our educational system to provide the most ef- 
ficient ana o*'-: active educational program that can possibly be provided 
for all people in terms of their abilities, needs, aptitudes, and aspira- 
tions, The Vet it ion a 1 Education Act states this purpose \ith specific 
reference to the improvement and expansion of the vocational education 
program. It is, therefore, the duty of those engaged in education and 
particularly in occupational education, to assist in the careful guidance 
of each individual toward an . area...t>,f.. educati on and employment in which suc- 
cess car, he achieved, and which will provide the means and sa'ci sf acti ons 
necessary t-: the American way of life. The careful selection and guidance 
of individuals for and toward occupational careers,, and training for these 
careers, is not only a safeguard to these individuals in terms of their own 
time and satisfaction, but provides for the efficiency of the occupational 
education program in relation to instruction, the development of meaning- 
ful curriculum design, the adjustment of the methodology of instruction, 
effective and efficient administrative planning, and the economic, social, 
industrial, and technological progress of our Nation. 

The Broadening Concept of Vocational Education 

If we are to accept the hypothesis that almost without exception 
everyone can be trained, the**., everyone needs to be trained, and that ev- 
eryone can be guioed, counseled, and motivated toward occupational train- 
in'g and job placement, we must know wnat each individual can be trained" 
for and what the capaci f. a-, and the needs- of each individual are. With 
this knowledge, guidance .award specific educational goals becomes mean- 
ingful and realistic. 
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employer is based on the ability of tne worker to produce or perform with- 
in the organizational framework of the place of employment. From the stand- 
point of the worker, however, success appears to depend on the overall sat- 
isfaction enjoyed as a result of employment in a specific type of work. 

If we are to train the individual to be "capable, suitable, or suffi- 
cient for the purpose, and adequately and properly qualified" for success 
in occupational work, it seems to me that we must begin with the measure- 
ment. and appraisal of competencies as early as possible in the life of that 
individual. It is necessary, then, that such appraisal begin on the ele- 
mentary level and that we watch the progress of the individual in terms of 
abilities, aptitudes, changes of, interest, likes and dislikes, attitudes 
toward work, and use of time. As the individual progresses measurements 
should be made at regular intervals so that changes and growth can be re- 
corded systematically, A complete and progressive record should be used 
in the analysis of the individual's needs and abilities. To be functional, 
measurement should be used for the purpose of guidance toward training that 
wi 1 1 prepare individuals to meet and adjust to varied job requirements and 
situations in occupational areas which are within the range of their abili- 
ties. If the growing employment needs of industry are to be met by occupa- 
tional education it is also essential that the training and selection of 
workers for employment be based on the extent to which each individual can 
be trained for productive work in a specific trade or occupational area of 
work, A further consideration should be the extent to which the/ i ndi vi - 
dual can socially, emotionally, and physically adjust to the present and 
ever changing requirements of a specific type of work, locally, nationally 
or wherever employment may exist, Th^se considerations cannot be’ made with- 
out objective evidence and a cumulative record of social, emotional, mental., 
and physical changes. 

Although the need for skilled workers in the traditional trades still 
exists, the nature of skills required to perform a particular job has, in 
many instances, changed from the performance of a tool process to the in- 
sertion of a tape and the pushing of a button or the pulling of a lever. 

Our changing technology has brought about new and sophisticated jobs, and 
demands that the individual be trained in diversified competencies which 
will make the transfer of job skills from one occupation to another possi- 
ble Changes in job requirements are an ever increasing threat to the em- 
ployment needs of industry and to the security of the worker. 

Because of the growth of automation, a number of less demanding jobs 
have disappeared or are disappearing in production processes. Jobs in less 
demanding occupations available to those with limited ability would now 
seem to fall i r; the service occupations group where the demand seems to be 
increasing. Oi.ce again, a general type of training and preparation seems 
to be necessary rather than training which appro ches the actual develop- 
ment of skills. It is necessary for the researcher in occupational educa- 
tion to discover those competencies needed to sati sfactori ly perform the 
duties of workers in the various trade and occupational areas through, re- 
search in these occupational areas. Through realistic analysis of needed 





competencies on the one hand, and an appraisal of competencies of poten- 
tial workers on the other, the basvs for effective and efficient training 
programs can be established This type of information should be funda- 
mental to the determination of course content, course length, methods of 
instruction, the selection of equipment, and the nature of the facilities 
to be used Just as this information can be used in the determination of 
program design, a reverse procedure in research design can be applied to 
the same type of data gathered during or at the end of training, or both, 
for the purpose of program evaluation. 

Measurement and App rais al Instruments 

if nieas u remen t and appraisal of individual competencies ‘■s to be mean- 
ingful, it must be accomp 1 ’ shed wth the individual learner as the prime 
consideration, rather than the course o* study, the curriculum, the plant, 
the school, ?' the admimstrat- on T oo often we set out to evaluate the 
effectiveness of instruction m the blacksmith shop where there are no 
horses to be shod Instruments ^o-- measurement and appraisal in occupa- 
tional training and employment must, be developed for use with all ages, 
and For ail levels of physiqa 1 and mental development Reference is made 
here to forms to be used by the occupational educator rather than the clm- 
1 cai psychologist Existing forms are often formidable and complicated, 
These forms cause testing or appra'sa' to be a harrowing experience parti- 
cularly, to those with r eac hng difficulties, language barriers, or to those 
who have not been recently exposed to evaluative instruments. Experience 
with various standardized aptitude tests administered to high school stu- 
dents during research experiments and in regular testing programs has re- 
vealed extreme difficulty on the part of these students in following com- 
p -cated directions _ind in reading the instructions as well as in reading 
the questions T he development and standardization of simple specialized 
instruments to be used at regular intervals for the purpose of developing 
competency profiles seems to be baddy needed Data obtained in research 
as a result of using tests that cannot be understood by those being meas- 
ured is useless data although "t has been used on many occasions in im- 
pressive tables and voluminous reports 

T o be effective, the development o^ sophisticated research relative 
to the appraisal of competencies must be based on the abilities, aptitudes, 
interests, and needs of the individual, not at the present time alone but 
on the potential of the individual to grow to the full extent of his capa- 
bilities. T he development of occupational skills, desirable attitudes, 
social growth, and the a b i 1 1 ty of the individual to adjust to varied con- 
ditions of employment are constantly changing factor's As such, they call 
for continued measurement and appraisal throughout, school life, training, 
and employment. Once again the use of forms and tools of measurement which 
would provide a progressive scale, or profile representing the individual's 
place in relation to the satisfaction of specific job needs or even broader 
occupational needs would seem highly desirable 

If the process of evaluation is to be mean ngful in terms of the goals 
of education, and specifically occupational education, its purpose cannot 



be that of screening, that is "screening out," but rather the discovery 
of abilities, aptitudes, and interests which may be developed in an in- 
dividual to equip him for a kind of work in which he can be successful 
and which will enable him to be a well adjusted, contributing, and pro- 
ductive member of society. Thus, the development of instruments for eval- 
uation, or the selection of existing measurement tools for the evaluation 
of competencies implies the existence of a program of guidance. The pro- 
gram must be such that the findings of research can be applied to the 
placement of the individual in a program of occupational training tnat 
will be efficient and effective in terms of the ^ i ndivi dual , in terms of 
the administration, instruction, methodology and economics of the train- 
ing program and in terms of the needs of industry. It becomes apparent 
that curriculum evaluation and development cannot be separated from the 
appraisal and evaluation of individual competencies and that neithe can 
be accomplished withou. an analysis of job requirements and the develop- 
ment of criterion measures based on these requirements. 

Pred ictive Testing 

The effectiveness of a progi am of occupational education may be said 
to be in direct relationship to the rare with which students are selected 
for the program. If this hypothesis is true, then the development or selec- 
tion of tools for selection of students for training, based on correlation 
with success at the end of a training program and in actual occupational 
employment is necessary. The problem of evaluating competencies then poses 
the problem of determining those characteristics which an individual should 
and must possess to be considered employable, or to go a step further, to 
be successful as an employee on a specific job level in a given trade or 
occupation. It ■' s therefore the function and perhaps the obligation of re- 
searchers in occupational education to develop criterion measures for each 
of the various occupations, trade areas, or occupational clusters. The 
purpose of these criteria would be their use as a basis for the placement 
cf individuals in occupational training programs for speci fi c trades or oc- 
cupational areas, and in employment best suited to their abilities and in- 
terests . 

The evaluation and assessment of competencies as a phase of the pupil 
selection process for programs of occupational education has been used in 
schools and school systems throughout the country for the purposes of screen- 
ing, prediction, and guidance. Although tn? collection and analysis of data 
relative to achievement on standardized forms has been used in screening, 
prediction, and guidance there seems to be little evidence of the use of. 
these data in correlation with objective criterion measures for success in 
occupational training or in specific areas of trade training. In the Nor- 
walk Study however criterion measures were developed to determine weaknes- 
ses, strengths and growth of the individual, at the beginning of the train- 
ing, during training, and at the end of training and during employment. 

These measures were of the questionnaire-rating scale variety and provided 
a p'ofile sheet, on which several profiles could be drawn for comparison. 
Criteria were established as a result of a study of employers' ratings of 
onjr>i 0 yer. n several different occupational areas. These areas includea 
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If tests a.-e to be used we must be well aware of the cultural ar ed j 
cationai characteristics of the individual, or individuals to be tested and 
select or develop instruments that will > on the reading level or compre 
hension level of those individuals . If testing <s to be beneficial ?n meas- 
urement and eval uati on , the importance and necessity of practical research 
before deciding on which tests to use and how these tests ar e to be "inter- 
?nii 6d ^ a '? not 1 be overestimated Although uniformity is desired readinc and 
interest ^evels vary and the evaluative instruments must be designed in t^rms 

ihn^ 6 , hn dlV/ldua $ T ° r Wh ° m the ’ nst aments a>’e to be used; in other words. 
those whose competencies ar e to be appraised or evaluated. Particular con- 
sideration must be made to prevent discrimination by carefully seiectinq and 

form ofVtest WhlC £ a a 6 slanted towa " d middle or select income groups The 
form of ^ test may be di sc^nn natory to some with limited backgrounds and 

oerfT^J ZZTl with limited ability to succeslfon, 

pe fo^.i a production tc. . or process. T es ts can be developed f 0 »- r eS earcn 

tn th^r i / i 1Ch i? an S 6 adniinistered both to the reader and to the non-reader 
to the culturally advantaged and to the culturally disadvantaged, and to 

those who speak English, and to those with language difficulty There is 
however no standard pattern of individual- ability or of industrial needs 
which wil permit the use of the exact same test forms in all situations 

h a : d II 2: h ?J- ln £ Vldua,S 1n a11 9e°graphi c areas Although some tests may 
be useable m the measurement of individual abilities in most situations' 
ana in most geographic areas, there is little evidence that any test pack- 
can be recommended as valid in all situations because of the differences 



age 



in educational rccju 1 * remen ts , 
and cultural backgrounds. 



procedures, and offerings, geographic areas 



involvL^rL + h 6 -^ be used we must consider the administrative problems 
V li^t individual and group testing. We must be constantly aware 

Dsvchoinnv Tf °h ? ne . nia ^ onty of educators in the practice of clinical 
J sfl p y nm -- PSyCh ?° 91Ca appraisal of ah individual is indicated we 

k - P u’T for appraisal by a clinical psychologist, Psychologi- 

t r •"h 1 b n a ? tem P ted by unqualified persons. The adminis- 

tration of tests to individuals or groups presents problems of time sDace> 

arS? 2 r anr™, and «*"!**••«<»• <”•«««? experience in the use of ^andl 

a lfl?k d nf experimental predictive testing and screesiWq has revealed 

a lack of efficiency in their administration and a lack of interest and 
training on the part of admi nistrat- s and proctors. Experience has indi- 
■ c d in order to counteract the effects of negative attitudes and 

^ack oi training on the part of administrators and proctors, special oner- 
tation materials must be developed for use in experiments or research in- 
•° ^Hd?t 3r9 i Sam P les ‘ . Th ° se materials include staff orientation materials 
tn h? ,!!h + t0 r! 0r T atl0n co/ered during orientation meetings, materials 
f e ^ ead tc students prior to t 'Sting, specific and detailed explanations 
! tln9 P roc edtrres m aodition to those provided in standardized te^t 
P a ^ ets > and actua1 step by step instructions to be followed by administra- 

Sr'ivi?v Pr ? ° rS / n f^ 9 the t6Stin9 peri0d ’ T " order to preserve the ob- 
jectivity of group testing it is highly desirable to provide trained pr 0C - 



to^s to administer tests 
this, close supervision by 



Where the 
the resea 1 



meaningless unless the condi 1 ons 



size of the sample is too large for 
■ch sta t is needed. Test results are 
of administration are conducive to the 
preservation~of~ thelTobJect, .1 ty *« "Uteri ng unsul tabl e tests nef- 

toward* measurement 

and appraisal. 

The development of new and simple data gathering devices having high 

, thin nanpr tn Dresent fully information rela- 

sarawriw. “« - - — 

instruments where the need is indicated 
Theve has been limited use ^ 

ai ^ educati ^‘research ^^Ihis'ins trument has parti^cu^ar^va^ue^i^n the^ap- 

studi es °o f f educational 0 prog rams such as the Baltimore Jocational ^Study^an^ 
the Yonkers Study to determine the advsability o ma 9 9 u3e 

which would affect t ^ a ° C ^^be 1 a^carefully 9 designed and constructed as the 
^an^ “ ^‘cSsi^ ex?™. should be given to con- 
tent in terms of the objectives /'^rtntervtli can Se iosf as a 

use of tests the objectivity of the structure i sgems tQ be the 

result of careless and unprofessiona ^ rc w i n the area of occupation- 

most serious limitation in *he “^ c 3"nte^1ew procedures must be 

ai education. Questions to be used and . j cpveral interviewers 

clear and definite so that obtained as a result of 

become engaged in the date, gathering process SD ecial check lists 

usmg the structured interview should be tabu! Jure of some re- 
developed specifically for this purpose . t b DU t it is advisable 

search studies, and the use to wnich th d t^ ^ £ 0 re then one inter _ 

“ei?»J e iSttr°,?^ li ^administration of the questions for the purpose 
Of comparing and analyzing dirferent. sets of responses, 

The use of the interest inventory in the appraisal of interests seemed 
to have little value in the Connecticut Study on Predictive Testing Its 

limited value in this stuCy and other research the appra; sal jf ™ t ’ rests . 
c-es is caused by the short duration of i ^ 1 e .7 n i ts use as the basis 

The value of the interest inventory then - rP c ea rch instrument in some 

for the interview rather than as an Impend. B . be used however in the 

col 1 ecti on^of 6 data U TSlSd-a!, or individual 
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groups according to age levels, geographic areas, school classes, or othe- 
groups having homogeneity. Therefore, careful consideration should be qi /- 
en to the use of the interest inventory as a research tool. 



School marks as a determinant or variable in research presents serious 
problems because of their general subjectivity and the absence of 
ized procedures i.i marking, many researchers have used 
marks in the analysis of competency studies. Although 
at the present time in the second phase of the Connecticut 
mine proficiency in various subject arcjs, it can result in a compounding 
O' subjective judgments and th.. tabulation of ' 



standard- 
averaged subject 
this is being done 
>tudy to deter- 



spurious data 



A1 though school marks have been used as variables in occupational re- 
sea-ch involv.ng the study of competencies, there seems to be limited evi- 
dence of the use of shop records or objective measurement or observation 
of actual shop performance T he individual work apprais'd! profile develou- 
eo as a result of objective observation and measurement has been used in 
oca. educational programs, and in professional and non-professi onal ern- 
pi oyinent for the purpose of appraising competencies Growth, and the rating 
of attiLudes, skills, and performance has been successfully accomplished 
through the development and use of instruments of this type. Such a de- 
vice, suggested by committees of vocational educators in New York State 
is now being constructed for use in the New York State predictive testinq 
stu de vel opment of carefully planned and designed work aporaisal 

profiles and performance check lists would contribute to tile measurement 
and appraisal of competencies in exploratory courses, tramina programs, 
and employment. The work appraisal profile and the .objectl ^"observation 
check list is invaluable in the appraisal of +he ability of 'the individual 
to worx with small objects rather than large, to work in a standing posi- 
■’on rather tnan a sitting position, and to work on repetitive rather tha*' 
individual processes* 



Competencies depend on all of those factors which influence the abiV- 
y o successfully perform work to be accomplished- The questionnaire has 
been used extensively to investigate factors which may have bearinq on com- 
petencies in a majority of studies. It is probably the most widely used 
instrument and as such has been the most abused. As an instrument for use 
in gathering data otherwise unobtainable it can be most effective and its 
value indisputable. It has particular value or application in survey studies 
wnere opinions and attitudes are being sought. In the recent Baltimore Vo- 
cational Study, questionnaires were used in connection with interviews to 
discover those factors which might have influence on pupil attitudes re la- 
ting to trade subjects and course offerings. In the Yonkers (New York) vo- 
cational Study three questionnaires were used for this purpose.' Quesiion- 
prepar f d for parents , pupils, and former oupils in this study. 
Although the use of these instruments provided valuable information their 
value might have been appreciably increased th rouge more efficient adminis- 
tration, As with other data gathering instruments, the value of the ques- 
tionnaire can be totally nullified by poor planning, extreme complexity, 
excess wording, and superfluous questions. It can be abused by those who 
would use it to the exclusion of other means of gathering data and by those 
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who , 
1 ess 



because of lack of understanding cf 
in its administration- 



f research practice , would be care- 



^ the rharacte-istics of the various research tools used 

Examination of the cnaracxe. i s n cs ui . .* v ,., n 1 P nt«: be devel- 

in collecting daua would suggest then that opec . ^ J an^rorriate in- 
cped for measurement and appraisal of competencies w Pw- ^ ry t0 

foments do not stem to exist. In spe cial instan ces it is "pessary t 
construct data gathering Instruments for use in a bo 

of research practtces may be employed in res earch p o e< understanding 
have been hampered in our resea : ch attempts oy gather’ ng instru- 

on the pari - of those assisting in the handling of data gatne_ ny 
meets o^ even in the handling of data which has been gathe ed. 

Practical considerations must be made in the development of any re- 

the factors mentioned suggests the nef c d *or . , nroups of individuals 

as they may affect the competencies ofmd, J’f J“? S kg % unds „f two 

groups of students may. toTs un, flilftS SS?Uy of 
t-h^studer.^ha^a^direct 1 relationshi^to his competencies in occupational 
work or in the performance of a given task- 
area at the University of T oiedo- If we are 
petenci es we must also measure those factors 
of those competencies. 



Work is being done in this 
to measure aria appraise com- 
which affect the development 



xs~ .. 

ssiful’S 

in experimental studies. in stua.es . . ffprt on the comoe- 

iation or the occupatl onal oPP^J^^s In emSlo^nt, a demographic 
tence or placement of those with co. pe , r-tnH-ioQ cprious con- 

analysis of the community is often "??abi?itv of" the sources 'from whi ch data 
si delation should be given to the reliability ot tne sources 

can be obtained- 
cie^e^The^t^ 
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ap p rcisa, o. competencies of large populations cannot be underestimated ir 
the development of a program of occupational education. The nature of anv 
given. population is that of its combined members rather thanNthat of sinqle 
individuals. In measuring and appraising the abilities, aptitudes, inter- 
est., and capabilities of the individual we are supplying the necessary in- 
formation for an analysis of the characteristics of an entire population 
In research design involving large populations, it is necessary to deter- 
mine the purpose and scope of the. study and to strictly adhere to gather- 
ing in. ormati on and data which will provide needed answers to problems and 
will be pertinent to the purpose of the investigation. Measurement and 
appraisal of competencies can be approached from the standpoint of study- 
ing the individual, or group of individuals, either through the qualitative 
.^Ll^jective survey method in which the general competencies , attitudes, 



J — ■' , . ~ awiwiui uumucuciiuci, dOLlLUUtib, 

or needs are studied such as .case studies of individuals, or surveys simi- 
lar to the Wilmington, Baltimore, and Yonkers Studies, or the quantitative 
and experimental method in which statistical data is collected for large 
group studies, matched groups, or in which controlled samples are compared 
after exposure to different experiences such as the Minnesota and Connecti- 
cut testing studies, or experimental studies involving the comparative val- 
ues of teaching techniques. 

In experimental studies involving the development of competencies and 
the. measurement and appraisal of these competencies, determinant variables 
or- intra-procedural factors are often detrimental to the objectivity of 
the resulting data. It is essential that these factors be controlled by 
careful planning of procedures in reference to uniform exposure of subjects 
l-n the experiment to units of instruction, instructiona.l__periods, and work 
or test periods. Experimental conditions of learning or measurerTeTt^oirTd^ 
be equal in all -phases of such studies. Experimental studies or studies of 
pupil progress conducted in an area of occupational training should be ear- 
ned out in a single shop to assure the similarity in spacial relations of 
machines to the subject, and the similarity of the adjustive movements nec- 
essary to perform particular machine operations. Variations in scheduling 
or time intervals between instruction and testing or between testing or re- 
testing of individuals or groups participating in an experiment, can ser-" 
lously affect the objectivity of the data obtained. The importance of 
scheduling, or order of procedures, in relation to interest span, memory, 
and fatigue is an important consideration in all experimentation and has 
par i cu l ar application to experimentation in the development of the ad- 
vanced skills. The measurement of competencies may also be affected by I 

instrumentation or instrument decay. The change in attitudes, or of the I 

physical condition of those engaged in observing or in rating, or the use 
of two different observers for each of two observations, would. possibly 
result in a non-objective set of data.. Experimentation can also be serious- 
ly handicapped by the mortality. of subjects resulting from school dropouts, 
transfer, illness, change of class, promotion, or change of job or vocation. 
This factor is of extreme importance in small sample studies in which groups 
are being compared or in which there has been controlled sampling. The 
careless selection of a sample for a study can have a negative effect on the 

results because of bias resulting from similarity training, backgrounds, or 
interests. 3 ’ 
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to'take in a discussion- of it d The^efSre^ u ? ? !" ar,y poss1ble Pathways 
some delimitation. The lim ts u I • USeful dlscussl '°" calls for 

ful ones for all purposes but th^Jii^ paper may not be tne most use* 
discussion, purposes Put they will serve to focus this particular 

signed for managerial^decisio^ma HI Hi th ?. problems of evaluation de- 

T he decision maker needs to know if his exp * nmental research . 

and if his instructions have obtained thl hdVe been foll ° wed 

experimental research worker wantc fn J he • ts be anticipated. The 
results from another: The experimental^™ ' f T raethod 9ives different 
t;ca! significance of the difference 1 ' al J! searct ' er emphasizes the statis- 
with expectation. The researcher fs‘int^,Tl 9 - r emphasizes consistency 
IS primarily interested in the end Drnrfnrtt ’? details; the manager 
necessary to obtain clear measures In centra i * detaU Steps whe " 
uations are not satisfactory for manaaeria? de' ! ? xpe " ,nenta, design eval- 
sporadic and because they take the detar I.? nit? because they are t0 ° 
complex. They are not onlv 0U ? of the nornial operating 

administer because they can onlv^^ 0 ^ 7 ’^ they are dl ' ff icult to 
tine of operation. The importance of b lhi" e iiT d ? st “. rbing the norma ' rou- 
cussion from any excessive a lC' an ?r to Lnelf ’! f nat u fraaa this dis- 
P ,6S 50 rauch ° f the attention of educational ^"arc'h S?s," MCh ° CCU ‘ 

the point 9 of operationTthe^pupi Tand hiT ^ f1 ° W ° f eVa,uativ e facts from 
Thus management consists of a two wav ct res P?nses, back to the manager, 
loves instructions; orders, loTcZ^f^T °" e braRch of the stream 
er and the return branch carries informati^^lTi^ 96 " 16 !^ d ° Wn to the work “ 
product. This information flew needs ?o Hp if ’ • ^ What happened to the 
regular intervals. The return flow co "t™uous, or, at least, at 

management on its toes, since it’is rLt^ y? tlon ls lhe P™d that keeps 
meeting expectations, which reqSi>e snec -T , rS Up fa11u ™ ‘ 

pectation b is met gives management th. P ,.ti,f^?^ 

from teacher o^^'rva'tio^^d^L^ S ^ CUre useful evaluations 

help him make better decisions The scientist H l? SeS an ^ thl ‘ n 9 that will 
tention to items that will contrihnL^ +1 ent > ot wants to restrict his at-' 
formation that can be depended UDon fnr°nf Cien i'- fl " C knowled 9e s i. e. , in- 
of managers and res earch Workers Te^T 4 ll2 J tions - Thus the needs 

include in his thinking the actual findings Sf’releaJch! 1 ^ Mna9er Sh ° Uld 





Institutional Purpose 

One of the problems in evaluation is the difficulty of establishing 
. the purpose of the institution being evaluated. Much evaluation and man- 
agement theory has been developed in private industry and then transfer- 
red to public institutions. Perhaps one should say that the transfer has 
been attempted, because many of the transfers have not been successful . 
Some of these difficulties have arisen because the interested persons 
failed to recognize that private industry has a clear-cut, easily defined 
purpose, the making of profits, and public institutions have loosely de- 
fined purposes that may change as the society changes. If successful 
transfers are to be made, the purposes of the institutions must be clari- 
/fied. The area of vocational education is no. exception. 

In the early days of vocational education, say in trie 1920-30 period, 
the proportion of the youth graduating from high school was less than 30 
percent. Since over half the youth had good qualifications to be. skil led 
workers, there were many not completing high school who had the desired ■ 
qualifications. . A simple and logical step was to create an institution 
oO teach specific skills, rather than the already established academic 
program. The best of those not attracted to the academic program could 
be admitted to this new vocational school. The success of the school could 
be established by showing that the graduates were sought by employers and 
did in fact become good workers. 

The success of the school depended on: 

1. A curriculum that prepared the individual for^a 
specific job cluster. 

2. The selection of individuals suitable. for both the __ . 

curriculum and the jobs. : 

3. Frequent use of individualized teaching methods, a 
close personal relationship between the vocational 
pupil and his teacher. 

The success of this early vocational school program contributed to 

and supplemented a general trend toward a revolution in educational think- 
ing. 



As already noted, in the 1920's less than 30 percent finished high 
school. Those who finished high school, including those in the vocational 
programs, secured better jobs and appeared to lead more satisfying lives 
than those who did. not. The result was a continuing pressure on everyone 
to complete high school, and now, in recent years, to continue in techni- 
cal institutes and colleges. As the proportion finishing high school in- 
creased, the. character of the school changed. The number of students ex-, 
actly suited for the vocational courses were limited, but the number want- 
ing to continue increased. The result was a tendency to admit the stu- 
dents to these programs who did not fit the curriculums or the job clus- 
ters. Some vocational schools were reduced to dumping grounds for pupils 
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who wanted to continue, but .were obviously incapable of academic work. 

The result was a change in logical purpose which was not always recog- 
nized by those directing the vocational schools. 

The puroose of this paper is not to give a history of vocational edu- 
cation, but to provide the essential information nece 
The reason for this diversion into history is to li.ustrate the fact tnat 
it is not always easy to define the logical purpose of an institution. The 
purpose of the early vocational schools was to train selected suitable in 
divi duals -for certain job-clusters. The success of the institution, by : 
extending the demand for such training to groups of pupils not suited for 
existing curriculums or job-clusters, changed the logica. n u^ 
institutions and made the traditional evaluative measures obsolete,. 

What Are the Logical Purposes of Vocational -Technical 

Education Today? ^ 

For the purposes of this paper it is not necessary to specify a sing. e^ 
present day purpose of vocational education but rather to indicate the range 
of possible purposes that may be selected by individual institutions and ,o 
show the ways in which evaluation has to adjust to purpose. 

Certainly the traditional goals are still acceptable for some institu- 
tions- Selected suitable individuals need training for specific jobs. How- 
ever, there is also obvious need for occupational training that will accept 
poorly qualified workers and bring them up to the quality needed by indus- 
try for the defined job-cluster. Thus some institutions are likely to ha/e 
the goal of producing well qualified workers out of persons who, in tradi- 
tional schools, would have been considered nonadmissable. 



Input-Output 

The discussion thus far forces us to recognize that important varia- 
bles are present at both ends of the school operation. The inputs . vary. 

The school contribution is a substantia"! part of the gain between inpu an 
output and few outputs are good evaluative measures by themselves. J us 
the discussion must cover both student input variables and student output 
variables, because some vocational schools are likely to be admitting dif- 
ferent kinds of students and expecting to bring them to a common output 
quality by the use of variable curriculums, while others will be admitting 
different kinds of students and expecting them to become different end- 
products, even though the treatments (curriculums) may be alike. 

Everyone knows that students vary. Some are good readers, some are 
poor, some are willing to learn abstract concepts and some want to con- 
fine their activities to the immediate and the practical., Evaluation calls 
for a very dear picture of the nature of' the variations because the : im- 
portant variables- must be identified and considered in valid^eva uations. 
Much of the latent resistance to evaluation in education is the lacK ot 
validity in many evaluative assertions. Teachers have seen evaluations 
that did not coincide with their inner feelings, and,: sometimes , the 
teachers have been vindicated by subsequent events. To insure that tins 
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paper will ultimately offer practical proposal's,. some time must be de- 
voted to describing the nature of student variability even. though all are 
familiar with its existence. A more precise description,' at this point, 
will insure a common base of understanding for persons using the paper. 

Human variability comes from three kinds of forces: 

T. Heredity, Earh individual is born with a sort of 
blueprint that defines his reactions to the environ- 
ments., he contacts. 

2. Envi ronment . Every individual responds to his 
‘"surroundings. 

3. Accidents or Chance . Some good things and some bad 
things happen to individuals accidentally. In one 
sense these are elements of heredity or environment 
but in many situations it is simpler to think of them 
as a third category because they happen without an 
apparent nonchance causal system. 

Perhaps the most important point for trie educator to keep in mind is 
that education is part of the environment and that the product of educa- 
tion, the mature adult, is a result of the interaction of these three 
forces. The part of the environment that is under the control of the edu- 
cational institution is limited, and all the other forces impinging on the 
individual are uncontrollable from the educational point, of view. The edu- - 
cator can try to correct for certain hereditary or environmental factors!, 
but he must accept the student as he comes to the institution. In prac- 
tice, some occupational training institutions refuse to accept students 
with unsatisfactory heredity or past .environment, but current national 
policy is demanding that some suitable educational institution be avail- 
able for everyone, and occupational education as a total movement must 
accept this more difficult assignment even though isolated institutions 
may escape from it. 

,The fact that development of the individual is tan interaction between 
heredity and environment carries an important corollary for the educator. 
This is that one cannot design a curriculum and predict how all students 
will react to it unless one knows the heredity and prior environment of 
all students. Thus, if a curriculum is designed for persons who handle 
mathematical concepts easily, a person lacking this capacity will probab- 
ly fail in it. Or a curriculum designed for the highly practical student, 
who is happy to work with materials and loves precision handwork, .will be 
poison to a slightly brain damaged person who has trouble making his hands 
do what his head knows should be done. 

A further point to remember is that the mature adult is not only the_ 
product of the school but is partly a product of the hereditary forces 
that determined his pattern of maturation as well as his nonschool environ- 
ment. Education is not only an instruction-learning situation but it is an 



environment within which cert'ain individuals will develop in a certain - 
way in accordance with their heredity. \j. 

1 N. ' 'i. . 

Many, in fact most, students have many similarities but the limited 
variations create very significant differences. A boy may have good eye- 
sight, an effective brain, good hand-eye coordination but if he has one 
divergence, and that a serious one, such as an uncontrollable temper, he 
will never make a good worker. The important differences tend to be iso- 
lated specifics, and the failure in many occupational training programs 
is the inability of the educational institution to overcome the isolated f 
handicaps. Thus, in looking' at the potential entrants to an occupational I 
training program, one should classify the prospective pupils by their j 

deficiencies'. Thus, the first and easiest class would be those who had 
no serious drawback characteristic. They are the individuals it is a 
pleasure to have in class. Another easy group to identify are those .who 
are mentally slow. Some of these will make very good end products if they, 
are given enough time. Another important group who may be hard to care for 
are the emotionally disturbed. A similarly hard group to plan for are the 
brain-damaged. Those officially identified as brain-damaged by the medi- 
cal profession are a very small percent of the school population, but some 
studies suggest that the group actually suffering from minimum brain damag 
may run as high as 15 percent 1 This classification of kinds of students 
needs to proceed until each group responds in a reasonably consistent man- 
ner to the -various training programs designed for the different kinds of 
persons. Unless groups are sorted in this manner it is hard to conceive 
of the evaluation being precise enough to yfeld good facts for managerial 
decision making. 

The result of this classification at the time of entrance of students 
into occupational training programs establishes groups of' like individuals 
who can be treated to special curriculums with the prospect of producing 
an expected end product. Even when the classiffeations have been refi'ne'd"' 
considerably there will be some failures in a group. The potential num-" 
ber of interactions between all of the heredities and all of the environ- 
ments is sc great that no classification can hope to take all of the dif- 
ferences into account. This proportion of failures should be relatively 
stable and can be a valuable tool for management. 

The basic problem of human variability for education is well expressed 
by Caspari in’ a recent issue of the American Educational Research Journal. 2 

In this article he said: x 

"As far as education is concerned, acceptance of the possi- 
bility of a heredity— environment interaction means, there- 



Zigler, Edward. "Mental Retardation: Current Issues and Approaches." 

"Child Development Research" (.Hoffman & Hoffman, editors')... Russell 
Sage Foundation. Vol.2, 1966, p.107. 

2 Caspari , Ernst. "Genetic Endowment 'and Environment in the Determination 
of Human Behavior: Biological Viewpoint." Amen can' Educational Research 

Journal . Vol . V-No.l, January 1968, p.54. — 
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- fore, that for reasons inherent in human nature a system 

of education which is best for al i individuals cannot be 
devised. 

This is from a practical point of' view adding difficul- 
ties to a field which even without this consideration is 
sufficiently complex. The attitude has, however, the re- 
deeming grace that it reemphasizes the dignity of the in- 
, dividual . Genetically , evje ry human being is unique, i.e., 

/ Afferent from every- other human being, that eveY* exi?ted,’ 
and ever-will exist— excepting of course monozygotic twins 
This implies primarily subtle metabolic differences be- 
tween individuals which, by means of differences in develop- 
ment, may become. amplified into differences in morphologi- 
cal, physiological and mental characters. The evolutionary 
past as well as the evolutionary future of man are depend- 
ent on this genetic variability. The uniqueness of the in- 
dividual will express itself in the unique way in which it 
will react to a specific environment. The challenge to i 

education appears to me to reside in the problem of how \ 

to create educational methods and environments which will \ 

be optimally adjusteo to the needs of unique individuals. \ 

The main contribution which a geneticist can make to edu- \ 

cational research is to stress the fundamental biological ' 
fact tnat every human being is a unique individual and that ' ■ 

his genetic individuality will be expressed in the way in 
which he reacts to environmental and educational experiences." 

. 0nce the impact of Caspari's comments have fully reaistered, the edu- 
cator real lzes^that he has a more difficult job than he had previously 
v.suanzed. Where one problem seemed to exist before, two or three prob- 
lems are going -to be in need of solution. The newly recognized complex- 
ity requires new techniques of observing and evaluating. The old t^ch- 

w]?i Ue noJ f K tradltl ? nal T ?^ erati0ns and Shrewd insights of capable educators 
nH f^L b V n0l i Sh ‘ They must be su PP° rted Py systematic control systems 
?nt£f baCk Ki° f ma J a ? erial ln format ion. No one has ready made solutions 
. I* P fob Isms, but research in evaluation has gone far enough to indi- 

9en r al of the P robable solutions. These will be discussed 

n a % ab ? trac 1 t ldeas in this first section of this paper. In Section 
II some actual evaluation. research will be described that gives operating 
perspective on these ideas and which as a matter of fact have been the 
basis for developing the ideas, and Section III will be a specific propos- 
al of a system of evaluative control for occupational training. \ 

TL . \' 

The Need for Absolute Measurement Scales. 






At all levels of education much of the measurement effort is relative 
or comparative rather than absolute. School grades, even college grades, 
tend to specify the approximate rsnk order of individuals in the work per- 
formed, rather than specifying what the person is able to do. This rank 
order concept is highly refined in the acnievement tests of the elementary 
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school. There are certain grave dangers in too heavy a reliance cnvrela- 
tive measures. Unless the educator is cautious in his use of these meas- 
ures he may lose sight of the minimum goals of his program. At some point, 4 
one has to look at achievement and ask— will this achievement do the job? 

Perhaps the problem will be clarified by an illustration trom a non- 
educational field. The problems faced by a manufacturer cf old fashioned 
can openers gives us a reasonable illustration. An old fashioned cari open^ 
er requires a cutting edge, a handle and a bearing surface to catch on thSs 
rim of the can. The angle between the bearing surface and the cutting ejfge 
is critical or it is difficult to get the necessary purchase to tear through 
the cover of the can. Now suppose we had 10 manufacturers of old fash'.,bned 
can openers and we gave them marks A, B, C, etc. The marks might give/ very 
adequate comparative ratings on the strength of the metal, the convenience 
of the handle, the sharpness of the cutting edge, etc., but, if the ratings 
never established the total effectiveness of the tool , the effort of all 10. 
producers might be wasted. The critical evaluative measure is the^effect- 
iveness of the completed tool. This is an absolute measure, a go,’ no-go 
guage in manufacturing terms.' 1 Even the fact that the tool will open one 
can is not enough. It must stand- up for opening hundreds of cans, and the 
comparative difference between opening one can and two cans is not very im- 
portant. (I am using this ill list ration because of a recent experience with 
an old-fashioned can opener in a motel kitchenette.) \ 

Occupational education particularly needs the discipline of setting 
absolute standards, minimum prerequisites in its program, and these mini- 
mums should be. determi ned.' by what satisfies and what does not satisfy the 
employer. Similarly, , clearly stated measures of capability among the en- 
trants into a program 'are needed if one is to establish the actual contri- 
bution of the educational institution. Relative status of pupils at en- 
trance and completion dees not give a clear indication of what the school . 
has added, ’ / 

Longitudinal Records 

Since an educational institution provides an environment in which an' 
individual matures one must consider the individual over a period of time. 

The individual enters the educational -institution at one stage in develop- 
ment, has certain developmental experiences and leaves at a new stage in 
development. Thus.., one individual may enter almost mature and another 
may enter at an immature stage. In the first case, the institution may 
turn out a fine product, but with little effort, while^ with the immature 
entrant, the final product may represent a lot pf institutional effort. 

For evaluation, these differences are important. 

Another reason why longitudinal records going back-toJihe educational 
life of the pupil are important is that some students are going to be un- 
satisfactory. As already noted our present cultural views do not allow 
us to discard. these unsatisfactory students but insists that they be made 
into adequate members of .society. Obviously some cannot be made satisfac- /, 
tory but society will go to great lengths to salvage them. The unsatis- 



factory student may be unsatisfactory because of an hereditary defect, 
or prior environmental insult. In such cases occupational training must 
nnd crutches of some kind to offset the defect. These crutches cannot 
be developed in the late teens, some have to be provided early in life 
to be. effective. Therefore occupational education must examine the total 
n te of the child to see how early it must intervene to achieve its goals. 

The School as Holder of Developmental Pattern 

... T h ^ school, of which occupational education is a part, has the respon- 
sibility for insuring that a child develops in a manner that will produce 
an aduit desired by the society, tach child tends to develop in a pattern 
or channel . A low IQ child tends to develop slowly. in academic knowledge 
and tends to be a low status worker as an adult. One of the great changes 
in educational thought in recent years, however, is the recognition that 
the IQ ii not really constant, that it only tends to be constant.. In other 
WGrds, if a school is good enough, it may stimulate some children to move 
rrom one developmental level to another. Such upward shifts in developmen- 
tal level are a crucial goal of the educational process, and the evaluation 
Oi educational institutions should emphasize the extent to which they suc- 
ceed in changing developmental patterns. The fact that vocational educa- 
tion in its old pattern of operation did this for some boys was one of its 
strengths . It is relatively easy to keep a child developing in an 
established pattern or channel but it is hard to get him to jump to a hiqh- 
er level . a 

1 he Critical Time to Produce Jumps 

There are probably- certain ages or developmental stages at which it 
is particularly likely that a child will change developmental channels. 
Little is known about these likely times to create change but the identi- 
fication of these times is an important element in educational planning. 

Closely related -_to this problem of developmental channels is develop- 
mental stages as hypothesized by Piaget, 3 He presents the idea of succes- 
sive stages in the development of children and to the extent that there 
are distinct stages there is always the possibility that a developmental 
stage will be affected by an hereditary or environmental distortion. Chi 1 - 

dren suffering from these distortions must be identified and helped where 
possible. 

These extensive comments on the general perspective of occupational 
evaluation lay the groundwork for a review of the research work that has 
been done on evaluating education; to see what elements can be transferred 
to the special field of occupational education. 




See Hunt, J. McV. " Intelligen ce and Experience" New York: Roland 

Press. 1961. 



68 63 



Section II - Research in Evaluation 
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well known Regents Tests. These are aimed at the individual and establish- 
ing how he is doing rather than at the institution to measure how well it 
is doing. Quality control in industry has the dual function of insuring 
the quality of the product and the quality of the factory operation. The 
achievement tests in the elementary and secondary schools have been used +o 
some extent to measure school quality but the results have been discouraq- 

I n9 i man - y cases the results did not correspond with the judgment of 

qualified observers and the interpretation of the results was confusing. 



In the late 1940 s the Research Offices of the New York State Educa- 
tion Department began a sustained effort to find a fair way of evaluating 
schools and this effort, which has now continued for over 20 years, has 
yielded. some important dividends. Recently a major study in this area 
has been organized in California 4 and studies have been conducted in Penn- 
sylvania and Kentucky. Iowa has long been a pioneer in school achievement 
tests and has used them for school evaluation. 



The lirst important findings in the New York study were that the tests 
particularly the group IQ tests, were subject to errors of administration. 
Secondly, there were true variations in patterns of mental development be- 
tween different kinds of pupils which made the idea of the constant IQ 
theoretically unsound. Much educational theory and evaluation had revolved 
around the constancy of the IQ and when various studies, including the New 
York State Study, invalidated this concept there was growing recognition of 
a need for some other control concept. 



In the mid 1950's New York State started its Quality Measurement Proj- ' 
ect which aimed at securing large numbers of pupil records in a sample of 
100 school systems and developing a fair scheme of evaluating the systems. 
This study yielded many valuable findings. From the first it was recognized 
that the basic difficulty revolved around the many variables that affected 
the quality of the schools. Early in the study it was noted that some scnool 
systems which, had been considered "lighthouse" schools, leading the way to 
better educational methods, were just fortunate schools that had a lot of 
bright children who had been given very high intelligence by their inheri- 
tance or the favorable envi ronment of their home Tife. Since these con- 
ditions could be identified by studying the community, a first step in im- 
proved evaluation was to classify the school districts' by the characteris- 
tics of the communi ty. This resulted in the development of norms of expec- 
tancy for different kinds of communities. Thus one could have a norm for 
large cities and another norm for - the suburban communities, etc. Each com- 
munity could then compare itself to a norm for its kind of community. This 



In 1967 a group of California school districts organized a major study 
of management methods under the title "Operation PEP," a statewide 
project to prepare planners in California. The address is 1870 El 
Camino Real, Burlingame, California, 94010. 






immediately -showed that the kind of c . ty important limita- 

determining the quality of a classification the fewer school 

tion, however, in that the more detailed th ^ and s00n the num ber would 

systems would be classified to^reclude any comparison. It also was 

dwfcun t© 9 compare 9 the^effectiveness of schools in different groups, x 

Even with these Imitations the study yielded ^t^that^in-pointed 

schools which were doing a ^ 1 ^ s P in q J a m y other than per pupil ex- 
tion pointing to causes of Jif^rences ^ 0 the id6a that ,mprove- 

^^rirschiol°S^S S co^d« by^ingenui ty rather than being en- 

tirely dependent on per pupil expenditure. 

. A refinement of these school and re ~ 

ing level of school distnc ^ 3 ^ p ^ S ! d the variation in the schools by ex- 
pression coefficients are obtained for the va^ then most of the varia- 

penditure, parental educati on or P a ^ a t eristi cs rather than by the amount 
tion is accounted forby parenta, character! stic^ra classification by school 

^^tri c^characterl sti cs^ inessential to* fai r comparisons between districts. 
Analysis by Kind of PupiJ. 

The evidence provided by schoo' !. r osf ^rboir^compan- sSn^^ 
advance but still did^not h^ossibili ty of pupil classification, 
tion was then rai sed of J beha v e d in different schools. — - 

one could see how a kind of ^ b een matched as to their character- 

educational experiments stud ® n ^ h e ® dea by identifying a group of chil- 
is tics. The proposal pursued tne same dea Dy i oj al1ke> and then 

dren in each of several schools who would be ess * ld in t he various 

comparing the achievement of this particular 

schools. 

To test out the idea pupils «rj .grouper i by the^socio^onomKstatus 
of their parents. This avoided the usua nfctno^ ^ ^ ^ JQ 

IQ which had been challenged by the new e expectation were ob- 

not constant. The results were striking, norms^o soc P oeconoiTlic childre n 
tained for various grades for high, medium of d d ‘ ubtful qua]it y were found 
and some schools which had be ^ averaqe For instance, a school primar- 
to be doing better than the state aver g. have low achievement tests 

ily dealing with low s ° cl0ec ° n °^ c i fthe State^ ^because of its high, proportion 
results compared to other sch . 00 \ s p but wbe n its achievement test 

of students from the low - S0C10 ^° °^ Dil s ^ere compared with achievement test 
results for the low socioeconom c pupi s were^co^^ relatTvely 

results of low socioeconomic students previous assumptions as 

high. Thus this type of analysis ^^e^that^ur^vi g that had 

to quality were definitely w 9- expenditures were not up to the 

lots of good students and high per pp, p • economic student. Per- 

state average in their education of the an Illustration of the diffi- 

haps it is worth pointing out that this is an 
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culty of designing a school system which is good for all. The schools 
^ ere good for the hl 9h socioeconomic student were frequently not 
good for the low and vice-versa. A few schools seem to have a clear • 

dS 0 well P foJ U r?l 0 I ^ dlfferin9 needs of different kinds of students to 
ao well for all socioeconomic groups. 

The vital point here is not the narrow one, that children with dif- 

ent^v^i^diffprp 0 ? 1 C backgrounds h f e deferent needs and perform differ- 
^ different schools, even if this narrow point is of importance 
but, rather, is the indication that when pupils are classified bv an im- 
portant characteristic other than IQ their performance is different So- 
cioeconomic differences should not, at this point, be considered the idea 1 
way of classifying children; it is just one way of doing it. 

data Sc Jhp^n n °f her available classifications in New York State 

data was the IQ of each child. This was used to establish expectancies 
for low, middle and high IQ pUpils. This classification was /of course, 

But lT„Tlh° ne -* Hl9 T IQ Chndre " d0 wel1 1n sch001 ' * °" a would expect, 
but one of the interesting points is that some schools have unexpected in-' 

consistencies in their ratings by socioeconomic and IQ classifications 

eh11dlS??hJn i!j h0 ? ls seer ? t0 be better in dealing with the low IQ 

children xhan with the low socioeconomic children. 1 

Another interesting fact that came out of the analysis was that an 

Thi's^raises Z V” cb11dren may do wel1 ™ « least one subject. 

1 ]], rai .^ S new quest! ons about the meaning of the IQ. How can a really 

^uh P^ 1n ar l tbme J ic? Perhaps any child who does well in one 

somfspecia/facto? SSUmed ° ^ potentia11y a high IQ child held back by 

rlaccffioU J nC " ta L St i! dy * children of low socioeconomic background were 
f d i y - li n the fourth grade and then the same children were clas- 
^h 111 th , e e ^ ghth grade. A high proportion of those who were low 
nradp f ? urt h grad e s 70 to 79 IQ, x were 20 to 30 points higher by the eighth 
a fairlv 1 ?- 0 ^? I° W , IQ children from the low socioeconomic grouo/iave 
a l*l r l y n bigh Tikelihood of really being average IQ or higher children'. / Thi 
seems to be conclusive evidence that the educational institutions should del 

IhP^ hi Tl t0 Chan9e I 2 S * rather 'than accept them. The change in IQ would 
then become a measure of school output. 



The Stochastic Pro cess 
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j„p n ol^!- Ser j° US ltmiting Actors in using classifications of chil- 
dren for educational measurement is the difficulty of measuring the criti- 

It r ct ?r st ! cs ^ Ch as tem e er “ ent ’ health, emotional stabfli^and 
attitude. The classification by socioeconomic status and IQ is fairly easv 

to obtain in most schools, but to make a comprehensive classification scheme 
appeared to require an expensive testing program. In 1963 New York State, 
uncier its Experimental Program, supported an, exploratory study of what 
could be done with existing pupil records to measure the educational proq- 
ress of the students. The study tirew out of a series of previous studies 



Of over- and under-aohi evemeit , whi ch chaos of the' 
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eral 1 attack fart^form^thls ^‘S’ttSlSS bS» interesting 

results. 

Another critical factor in the ultimate toocess^the^study^as the^ 

design of a simple graphic pupil rec r * - r, ur noses of this 

packs a lot of information in a smallspace.Fo pp 

study the focus was on ease of classifying the pattern or aever ^ 

a h graphic summary C presenptio^that°cou^d be^^nterprete^and summarized^ 

some advanced math books. The dictionary f'+t, 0 n r ptiraiiv nossible 
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largely presented in this form. , 

In order to report the findings of the study and make the ’"^cations 
for the evaluation of occupational education clear pl re j f shows three 

gram must be included in this L-L us \ proceeding from elementary school, 
tree diagrams of achievement test ^ tree diagram (group 1) shows 

through junior high and senior high* “* rh-ndrpn The second (group 2) 

if the sheet of paper were larger, this c0 ^ d ^ al/the 1079 children 
four-step tree, rather than a three-step, by 1 s Sloeconom1 c groups 

Mi? ur 

X?. ^“^cea ksThe 
i^junio^high^etc^Not^that the°percentage 

percent, secured good achievement tes ^ 233 were poor in elementary 
ping down to the bottom of the page* ^ . /to nercentj and of 

School and only 27 of these were good in junior high 02 Percent )„an ^ 

. these only 16 (59 percent; were good in senior hi> N t hoo , but 

-r- w. > as for one 



who did good work in both elementary and junior high (86 percent). It is 
interesting for purposes of seeing the power of this kind of analysis to 
look at group 3 even though the number of pupils is rather low (77) for 
generalizing. Of those who were good in elementary school only 6 were qood 
in junior high- (30 percent) as compared to 64 percent in group 1. In oth=r 
words, it a child is from the low socioeconomic group and starts "well in ^ 
elementary school his prospect of slipping in junior high is much higher 
than for those from the high socioeconomic group with the same good start 
However, once he has cleared the junior high hurdle, the low socioeconomic 
person has as good or a better chance to do well in senior high as the hiqh 
socioeconomic person (100 percent to 86 percent). Similarly, of those in 

frnm P thP ^ r0U P low so.c' oeconomi c classification the rate of moving : 

from the poor to the good is well below the rate for those in the hiqh so- ' 
coeconomi c classification. y 

The power in this technique lies in the fact that, by usina the in- 
formation readily available in the school records, and classifying by a 
senes of such measures, one can describe a pupil more and more accurately 

x nXTv cl rrr and c , learer ^^tion he i s m s 2 ii y - 

the next step of the normal process of his educational development. 

data suggests man ^ hypotheses that school 

apd ?uni 0 r h h?ih Xt lde r* Flr 1 What happens between elementary school 
m Dn+ J ^ n ‘°i r -? hl ? n c ? at makes so man y Children drop Tower in their achieve- 
ment level? Is this a necessary result or could relatively simple chances 

™P° rt ? nt differences? Also if some children can improve from elemen- 

statuX^p 10r hl9 J ! C « o1 Why can,t more do it? Wh ^ does socioeconomic 
status make so much difference in the progress of the children, even after 

they have apparently established their ability level? 

thp n+h^-? i 5-' preSe I ta j ton 0f the 9 eneral nature of the analysis some of 
the other findings of the study can be presented more briefly. The items 
selected for comment here are those that bring out the nature of pupil 

evaluations ^ that ' show the Possibility of using the data for comparative 

ment lilt T* prepared f ? r teacher grades as wel1 as for achieve- 

eni test results. In some ways these were even more striking. 

v , + w° f 3 ^ 8 . bo ^ s5 . who rated good in elementary school only 168 (48 percent) 

enfor 9 Mnh ln TX high ’„ and ° f these only 93 < 55 Percent) raied gXd in ' 
senior high. In other words, only 93 out of 348 (or 27 percent) rated good 

all the way through. The figure for the girls was a little better, 32 per- 

cent. .For the boys who were poor only 5 out of 152 (or 3 percent) were qood 

highXh'^ J igh sch ° o1 ” Almost 10 percent of the girls had good grades in 



5 Note that this is drawn from another table than that showing socioecono- 
mic status in Figure II. . 
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Looking at the number who /^percent) ended 8 up b poor W in senior 

svir'™ " 

87 percent) were still poor in senior high school. 

, • j.l q toarhpr arades than in schiGVGrnGnt 

The higher attrition rates i careful examination of individual 

results was a surprising development. more sens itive indicator of 

records indicated that teacher jj than achievement test scores. A pupil 
the work characteristics of a p P 1 ^ ld t r teacher grades one or 
who was starting to slip in his ^ achievement test results, 

two years or more before, i t would sho P des might be a help- 

This suggests that a careful analysis of teacn^ g ^ . n the public 

ful managerial too.. T e a ^r 9™ philosophies o/grading varying from 
schools, are a result of dis^ W ere P more inservice training on how to grade 

they h cou 1 d probably be made into an even more valuable tool. 

Another interesting analysis. was a. comparison 

tary to junior high and senior high crhool there were 3 who showed 

dren with IQs of 100-109 in the el en^ntary “4 other direction 

120 or better by senior high and 32 show - proportion moving 

7 were down to 80-89 and only 1 on T ^ov ing down, and the pro- 

up was substantially higher than t P P oints ) W as considerable, 43 , 
portion moving substantially .more t P id ' ce that group IQ results 

as s rarst^ssssK-. — *• 

Va riation bv Schools 

For evaluation purposes one wants o^tranother^Thereforfone^ 
a school performs at one tune in compart son .j, results 

should examine the stochastic process result! .to For 

with large enough differences to aid . 9 as doing above grade level 

one such comparison the children were identified as doing a 9^.^ 
work in reading and in arithmetic ,n the fifth grade^ a , 0 

by teacher grades 'n senior high school I ’ in the fifth 

studied, 66 percent of those doi g & g , high. In the .poorest 
grade were securing good teacher grades . 25 perC e n t. The sample 

School in the 1° studied the proper 10 ro ped to de 

apart ^overwhelmi ngly t stati s ti cal ly significant and, obviously significant 
operationally. 

Another interesting comparison' was to ciassi^ by grade 
level and then to compare the senior high adhievement^scor^^ showed 

reading at 'the ninth grade level in f -- 9 » nercent had good achieve- 

good teacher grades in the discussion above, 100 percent^had g^ ^ 

n?rp d e reading level therifth^rad^showed 
?ehfto t 9 poor a s^oor n Sf^«rit grade level in reading the good school 



Figure I 

Achievement Test Kesults of Pupils Classified by Socioeconomic Group: 
Elementary, Junior High, and Senior High School 
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showed 26 percent getting good achievement test results and the poor school 
had none getting good achievement test results. This type of analysis sug- 
gests that good grade level reading in the fifth grade is not enough to 9 
prepare pupils to do good work in high school. This is an illustration ! 

ahc^iM+ P ° lnt made ’2 th ®. first section of this paper that there should be 
absolute measures of achievement rather than relative measures. Pupils need 

h rea ?l n 5 -JV! 1 ^ to . d ? what is expected of them. If the average 
student doesn t do this level it means that the school is not doing what it 

n s J,°J ld :' E Y en ■"? the good school the grade level for reading was not ade- 
quate for insuring good achievement levels in high school, this is pretty 
strong evidence that the school expectations should be changed. 

This section has shown that there are numerous tools available for 
evaluating schools with greater precision than has been considered possi^ 

edurl?!-^ 6 ^^’ Few °( these tools have Seen supplied to occupational 
education and fewer still to occupational education at the college level. 

’■? next section of this paper will deal with a description of the evalu- 
ation problem at the college level and discuss the ways in which these 
tools can be adapted to the college level problem of evaluating occupa- 
tional education. 3 K 
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Every institution aces the ; s^u^nicSSll^r 1 colleges 1n- 

S an^colleges^ha^boon^M J* feS Weaknesses. 

StIrtar2Mn3S^«nd ■ 

ttWte^ncy n to n %1ate 9 soundness of Program to ^’y?"stitutions^UStr- 

nroblems are particularly acute where new development-^ 

P rom under the surge of " e « *° S&ES? ^presents this kind of < .si to- 
junior colleges and technical the prob «s of «ten* d 

ation and many a b]® P • . +hem. Accreditation is of g exist- 

justification new institutions nee 

measure the new goals. evaluative 

deviceWthaWWlWresponWto^the^^edfttWgoal WoftheWnsti^tu^^^^n' 

support if current njeds-ar become valuable citizens. . 

unattractive candidates and help the necessa ry function, but so-ie 



The keys to managerial control are: 



,■ Clear statement of purpose and the governing 
philosophy. 

2 : Knowledge of what is actually happening in 

terms of purpose. 
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3. Identification of the critical change points 
in the operation being managed . 



that has met these criteria can summarize its opera- 
form which will satisfy the public on the quality of its per- 
This will be a justification in the frame of its purposes 



An institution 
tions in a 
fo rmance, 

rather than in traditional terms, and will provide the needed flexibility 
to justi iy new institutions for new purposes. * 

The remainder of this paper will be devoted to outlining the exist- 
ing situation in occupational education and the procedures that can be 
expected to develop ^nto the needed control systems. The actual mana- 
gerial control practices of technical institutes have not been systemat- 
ic 11 :/ explored. The American Technical Education Association recognized 
the need for more information in this area several years ago and in 1964 

+^ ar n c t n^-2- an ft l r develo P‘> n 9 this type of information. It applied to 
the u b. Office of Education for a grant and secured funds for a pilot 
study on the problems of managerial control. The actual title of the 
stuay was The Development and Testing of Instruments and Procedures for 
a Study of Student Selection Practices in Technical Education Proqrams " 6 
A he economy moves since that time have prevented the hoped for major study 

However, the pilot study findings give a reasonable base for this discus- 
sion. 



. . . rhe study covered five institutions selected for recognized 

h^gn Qua . i uy of work and for variation in characteristics . The five in- 
cluded public and private, restricted entrance, and open entrance insti- 
tutions and they were widely scattered geographi cally . Therefore the 
Tindmgs should represent what is happening in good institutions rather 
than an average condition. 



m general the managerial information available in these ins 
concerning student gains and student characteristi cs was limited 
marizirig the results and conclusions the report said: 



ti tuti ons 
In surr- 



The useful practices found 



While only one institution visited had a comprehensive sys 
tern of r 6porting and control that appealed to the interviewing 
staff as reasonably complete in following the progress of the 
individual, all had specific operations that seemed to contri- 
bute to the maintenance of quality. None had a comprehensive 
system of institutional self-evaluation. Among the useful 
practices were: 

\ 

1, Special curriculums for persons with inadequate 
prior education. 
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2. Specific et forts to help students overcome areas 

of weakness . 

3. In-service training for teachers. 

4. Personality ratings by high school staff for 

pupils to be considered for admission. 

5. Careful ratings by teachers and work supervisors 

involving work -habits and attitudes, 

6. Extensive counseling to help students select proper 

programs. 

7. Follow-up on graduates to establish kind of job and 

success in filling it. 

8. Placement service to insure that all graduates qet 

jobs, 

9. Comparison, of characteristics of students with suc- 

cess in school programs. 

10. Frequency distribution review of grades given to 

identify weak spots in curriculum or teachinq 
staff. a 

11. Lateral transfers from curriculum to curriculum 

within an institution to help students find a 
program they like and in which they do good work. 

-Implications of the findings 

1. The selection process must be considered in relation 

to the program. There is no value in admitting 
students unless the admitting institution has a 
program suitable for. them as individuals as well 
as aimed at their goal. 

2. Curriculums must be designed for types of persons as 

well as for job clusters. The pre-technical course 
discussed in prior sections of this report is an 
illustration of a course designed for certain types 
of individuals with certain goals. 

3. The selection process _ cannot be sati sfactori ly 

judged until objective standards of educational 
success have been established. At present no one 
knows what kinds of marginal students can be helped 
or what the maximum capacity of a student might be. 
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The selection process must consider the needs of 
the whole group. From the social point of view, 
an institution -has not established the soundness 
of its admi ssion^oH-cy_by showing that everyone 
admitted succeeded. It aTscrims to show that 
everyone who might logically have~"appl ied and was 
capable of doing the work was admitted. 

5. The establishment of objective standards will require 
the maintenance and analysis of longitudinal record 
files. The essence of quality measurement in these 
institutions is in relating guidance decisions with 
results and this can only be done by following the 
individual over a period of years through the whole 
process of admission, education and early job exper- 
ience. 

"General comments 

The most serious difficulty in the selection process from the 
viewpoint of this study appears to be the limited concept of institu- 
tional responsibility of making a success of the student who comes to 
them. Many merely select the ones that seem to be obviously suited 
to their programs. Others, the open admission type, consider that 
they have met their responsibility when they have admitted the stu- 
dent and the student adjusts to their offering or drops out. None of 
the schools visited had a continuous program of determining why drop- 
outs occurred or what their characteristics were. In one school 
visited there was a general effort to open alternative routes speci- 
fically designed for the identified needs of particular students or 
kinds of students and in two others there were limited alternatives. 

A^ll of the schools probably have programs that are used success- 
fully for meeting particular problems. The schools with a pre-techni- 
cal program or corrective courses illustrate this. These are excel- 
lent as far as they go and represent a most commendable alertness on 
the part of the administrators in seeing a need and meeting it. How- 
ever, the recognized needs appear to be only a few of the needs. The 
basic need is for a system of responsibility that will result in sta- 
tistical analysis of the school operations so that all the needs will 
be observed and met. io do this, records must be kept of what happens 
to different kinds of students as they proceed through the technical 
programs. The policies of the counselors must be checked against the 
realities of who succeeds and who fails. The failures must all be 
studied to establish Lne cause of failure and reviewed to see if th€ 
cause is an invariate that cannot be modified. If an adjustment is 
possible, the technique of the adjustment must be worked cut. 

One school acting alone can seldom determine the ultimate possi- 
bility inherent in each type of pupil because the various potentials 
will only show themselves in different environments. If expectancies 
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could be worked out in 
schools there would be 
effective action at the 



a cooperative program among a group of 
an interesting possibility of getting 



school level 



Haying established the fact that technical institutes have not devel- 
oped satisfactory ways of evaluating their programs, the next step is to 
propose a workable plan for securing the necessary data. 

Referring to Section II of this paper the experience in public school 
evaluation shows that classification is essential to separate out the ef- 
fect of the multiplicity of causes. Many educational studies have approached 
the multiplicity of causes by using regression coefficients. These are use- 
ru tor detemining the relative importance of causes and for predicting re- 
suits, dul they do not lend themselves to operational decision making as well 
as classification does by isolating single factors. Therefore, for our de- 
sign purposes we should consider a system of classification, although an ef- 
fective system of predicting from regression coefficients and comparing pre- 
diction and result js possible. In the public schools the classification 
by type of school district was quite effective. In the case of technical 
institutes the classification by kind of institute or kind of program would 
of some value, but the variations from institution to institution are so 
numerous.that.it does not seem very promising. This leaves the classifica- 
tion of individuals as the crucial device for securing the precision of ob- 
servation needed for managerial control. 

f 

I 

The institutes cannot afford to engage in an exhaustive testinq pro- 
gram for each applicant but they can get transcripts of their high school 
- records. From the high school record and an interview, the admissions offi- 
cer of the technical institute can classify the students into several qroups. 
.or each curriculum the admissions officer could estimate the kind of work 
to be anticipated if the person under consideration were admitted to the 
program. Thus. a person with a good high school record and who gives a qood 
impression on interview should be expected to do well in a difficult curri- 
culum A student who has barely secured his high school diploma with a 
he ^J oa ? D ? and occasional F's can be expected to fail if placed in 
* 1 i cul t . curri cul um. An in-between student could be expected to get 

through a difficult curriculum but not to do well in it. 

Once a student was identified in an expectancy group, a code number 
could be added to his identification number and at the end of the first 
semester, by a simple sorting and tabulating operation, the course re- 
sults could be reviewed in comparison to the results expected by the ad- 

Figure n iII fflCer ‘ The rep0rt f ° r 3 physics course might be as shown in 



. sim P^ e table would point to a number of items that should re- 

ceive, the attention of the top administrative staff. First, why should 
five individuals in the promising group get D's? Is there a transition 
problem for some students as. they move from high school to technical in- 
s itute. . Or is the trouble in the way the physics course is presented? 
Ur, looking at the hopeless group, was the classification of hopeless re- 
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Figure III 



Report for Physics I, Fall Semester 1969 
■ Receiving 



Type of 


Total 


A's 


B's 


C's 


D's 


Fail inq 


student 


number 


No. % 


No. % 


No. % 


No. % 


No. % 


Promising 


50 


25 


10 


10 


5 ■ 


— 


Good 


50 


15 


20 


10 


4 


1 


Poor 


50 


-- 


5 


10 


25 


10 


Hopeless 


50 


-- 


1 


10 


20 


19 



liable when one student received a B and 10 got C's? However, when tables 
like this are maintained for several years, they can be compared and, if 
the proportion of the promising students getting A's goes down, something 
has happened and management should find out if the reason is good or not 
good. Such an event might be the result of a change in. the judgment of 
the admissions officer or in the way. the course was presented. In either 
case management should know how its instructions are being carried out. 

Similar tables would be prepared for all subjects and for each semes- 
ter in the career of the students. Where a student demonstrated that the 
initial expectation of the admissions officer was wrong, he should be 
shifted to his proper expectancy group. Tree diagrams could be prepared 
showing how each group developed in the institute. 

The. tree diagram provides a good deal of interesting information. Of 
course the figures are not real, but they are the kind of figures that one 
might get, and hence it is interesting to see the kind of managerial de- 
cision material that might be drawn from such a report. The startling item 
is that several promising individuals end up doing poor work in school and 
on the job. Since all prior information had indicated that these people 
should succeed, their failure suggests that something may be - wrong with 
the school program for certain individuals. If a similar tree diagram were 
constructed for the poor prospects, and a high proportion succeeded, one 
would logically wonder if one's judgment of what constitutes good material 
was correct. Such a finding would support the idea that educational oppor- 
tunity was affected by prejudice of some kind. 

0nce this pattern of analysis is started and really used in an insti- 
tution, many improvements will be developed. More elaborate or sharper^ 
classification schemes will be devised. Better techniques of determining 
who will succeed will be found when the admissions officers face an annual 
report that shows their successes and failures. The experience in factor- 
ies and in education is that the managerial staff only come to use this 
type of material slowly. They are in the habit of making decisions on the 
basis of inadequate information and it is easier to go on in the old pattern 



Figure IV 



TrPP Diagram of the Promising Students^ 



Class of 1969 
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unle S s there is pressure for change. The new techniques will onlv be ac- 
cepted under inservice training programs and under -the pressure of someone 
in authority who insists on knowing the kind of a job that has been done 
in many cases this will be the chief executive of a political unit his 
budget agency or a legislative body. The pressures for the use of’this 

"he habit^f r +h * a ] ready building up and the wise executive will form 

his hand! f thlnking ln thls pattern before the outside pressures force 



This type of nmerial is very valuable to the individual institution 
but becomes even more valuable as it is produced and used in a fairly stSnd- 
by many 1 n sti tutions . When similar material from a group of in- 
can , be P ut together one can establish a standard of expectation 
hpff f lff ?r en J kl " ds of individuals, and some institutions are likely to be 
better adjusted to certain individual needs than others. By studyinq the 
characteristics of the institutions doing well, other institutions can aet 
ideas for improvement. Thus the technique has a built in system for grad? 
ual im P r °vement and for maintaining good practices once they are established. 

The discussion of the reports thus far has been in the framework of 

cwricululs' iTwill . The .? a f, da t a wil1 valuable to those planning on 
riculumsThaf in lc,raad ; atal y focus sharper attention on design of cur- 
T in,,- 2 1 : c ? nnect kinds of persons and kinds of jobs, instead of 

lowing the curriculum planners to think in terms of jobs only, as they 

sometimes do. It will also focus attention on the persons failinq to qet 
in the present programs or failing to succeed if they do get in 9 There i< 
reason to believe that^if suitable attention is focused on the problems of 
these people, methods of meeting their problems can be devised 

The Immediate Next Steps 

a rrnifnp IZ engaged in occupational education would set up 

tested in tl maintaining the type of records suggested, the ideas couldbe 

y 0r tw0 ° The cost of mai 'ntaining the records in an insti- 
tution with a computer available for record keeping would be very smlll 

The biggest expense in getting the technique started is traininq DeoDle to 

Zt .ttaSl? df r ter f i iS dvai,able - * educational 'manage- 

ment methods is waiting for an entrance cue. 
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A CONCEPTUAL KOOEL FOR THE EVALUATION^^ 

° F 

"The education of man i s ^. hu ““ 4 a 2 wa ^ 1 ) " 9 '' S ucf 

fcss*i ,n % 

total environment. Man tain t v _ 

• j hiaher education is not ~o ma 
"The purpose of elementary an equ ip his mind with an or- 

t hP youth a truly wise man* N £ 3 ^ £ advance toward wisdom 
dered knowledge which will enable ^ ^ provide him with the 
in his manhood. Its speci a1 . universal and articulate 

foundations of real jns om, and wit ^ . c1 d culture, b - 



vocational tranmia.. 1 ha _ is on ' 

tional education in stereotypic fa f^" a | h e children of the "other fam ; 
ftr the lower socio-economic masses, f M l want my child to have. 

as training, but rather as_ true difference justifiable. 

« ;s s ss s rurusa;. 

community will these . ks f 0 t occupational education accep- 

that onerfif the immediatetasKS ucationa l community. Such acc P _ 

•w. gaining wider acceptance wi thin the eo n retain s or does not over 

w-4 «• 
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process of occupational education itself which will lead to nrnaramc T nw. 
sensitix/ely geared to the "human awakening" of the students /but will'al- 
so begin to refocus the myopic vision of so many whose support is criti- 
cally needed in our increasingly technological age, 

r a +irj h frs f0r ^ this £ a £ er iS 901 ’ ng t0 focus on areas which need clarifi- 
a d reflne ™ ent for an ^proved state of occupational education. 

nation/ P pH 9re ? S ha L been made 1 n the cognitive and skills area in occu- 
b r c f o I h ° o n than in A reas /elated to other human factors which may 
.kill/ ntl Jh the successful integration of the newly gained cognitive 
1 p 55* 1 total personalty system of the student. Modern psychology 

Jhat f tL? J 6d th ! nec f? sit ^ of total Personality integration, 

J bab Zl^ a !_:?r.. a ,P! rson to- achieve maximum growth, the various compon- 



.. . person to- achieve maximum growth, 

ents of hi s personal ity' must be in harmony and not in conflict, 



The concept of the human personality is not a static one, but rathe- 
?pL?n Contlnu ' 1 "? dynamic change, r he late Gordon Allport of Harvard! a‘ 

i nQ f a ,n-Spi S h na !h ty th +°K 1 ! t? V1ewed Personality as a process of "becom- 
h " 9 . gu ? ded past hut °r en ted toward the future. In fact in one of 

s books entitled. Becoming (1955), he pointed out that such a view of 

at the root of education and should be given full atten- 

!hanqe y w!- e tty* i*”" ^ P ° 1nt t0 be made here is that Personality 
change wt, take place, be it positive when there is an integration of 

process components or negative when conflict promotes disintegration of 

relationship i BUt h ?i d ° e - thlS relate t0 occupational education? The 
re ationship is really quite erect and is somewhat as follows. 

Drim/il^/cumr 3 he f 0CUS in occupational education has been directed 
LI/ 1 s devel 0 Pment . It is not until recently that more and 
attention has been given to non-cogni ti ve and non-skills development, 

mS/!at?^n^ e / U - PerS ° n / ity com P° nents as attitude formation and change, 
motivational dynamics, and patterns of interest. It is known now that it 

Dreoa!ina°thP vocational skill to a 17 year old youth without 

E P ,L -i. he res 3 P er ^onality system tc accept this skill, to in- 

L^ b rate it as par^ of himself and to make it a source of sel f-identi tv 
J n a ff how well trained an individual is, he is not educated unti/he 
ea.ns to maximize the input of his training in terms of a productive out- 
put of activity whether this output be inner directed toward further self- 
development or outer directed as productive endeavor. And it is not until 

r!n^in/? re w OT + education an ^ more of the American public realize that cc- 
ac^pntsnrp I™ teday is attempting to educate the total man that wider 

acceptance into the genera, educational community will be achieved. 



It is 
components 



necessery th a t even greater attention be given those personality 

in nccun»tinnli h allow ^° r the duller utilization of the skills achieved 

• J P 1 Here the psychologist can make a contribution and 

't Wlll _be the focus of the rest of this paper to address itself to several 
p erson a lit y dynamics which are non-cogni ti ve and non-skill in nature but 
which relate directly to the process of occupational education. First the 
notion of personality will be, examined as a framework within which to re- 
ate t..e variacles of attitudes, motives and interests to be considered. 
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5f H i S ^ h 1 0pe ^ - that m * terial wil1 be presented in such a way as to pro- 

be attri buted^to°the tntaf ^ be t the bas ^ s for assessing change which may 
tinn +o • ^ opa occupational education environment. In addi- 

tion to providing such a model, suggestions relating to the ident1f?r»««n 
and measurement of such change will be made. 9 identification 

PERSONALITY: A DYNAMIC CONSTRUCT 

It is not the intention here to outline or summarize an underaradnatp 

f tbe ° ry \ but 1* "ecessary to olr & 

potenti a??v -e?a^ "n’TIf Uy ls / ub J ect to change and how this change 
5 y ela 1 tes "° the process of occupational education. There are 

•, ° US P er ^ ona ^ i ^ theories , but the position of Gordon All port seems to 
-p ce a great emphasis upon the individual as an individual and seems to Lp 
consistent with observable behavior. Allport def i‘nes personality^ 17 "SL 

Zr^Zr^° n Within ' the 1nd, *«u«l .of those psychopKyll^l sysIems 

. . lne his unique adjustments to his environments 11 (1937 d 4 fil 

Severa! concepts need to be clarified in this definition First one '?ote- 

constant S state th f S’ 11 " 3 ? 8 “ dynamlc organization" that personality is in a " 
dether^ bv a iLrli development and change, while at the same time bound to- 
f ,, y , ^ er t a in orderliness, system, or integrating function. The use 
ovr f e - W0 1 rd psychophysical "suggests that personality is " ... neither 

operatior of^oth^d exc ^ us ? v $ ly neural. The organization entails the 
operation of both body and mind inextricably fused into a personal unity, 1 

something ^definPd hv Jh faCt tba f perSOnal ity is something and does 
words 9 Per<;onI i tv 7 6 “SVf- he WOrd Ermine." In AllportT 

th^Uvi;™/ 1 ?^;^!^ SPeCif1C acts and 

entitv h f-m^^ ““P™. theory posits that an individual is a dynamic 

of "becoming" d is n | f ^? n ?? , Ailport also specifies how this process 

within ?he ind vi u m ' nd . pr ° vi des for a limitless plasticity 

wen sDnnas nf hph^li He ^ S by demons trating that motives, the 

sp.ings of behavior, are .ictionally autonomous " that is thpv 

"°I TT P ] e ;-- ly .T P . endent u P° n the Past, but rather supported ’by h the 

dividual is S*A PmiVed future 9031 atta i™ents What an in- 

io Jow'he wi?f r be"av 9 e? P ^ ° r not be “ me 1s the most 1m P-tant key 



of future a beha P vi'n?° l0 | 1 r tS have k turned t» ^ P a =t to unlock the riddle 
Turure behavior. But such theorizing almost forces one to accent th P 

tinI? n -i-h ha J P ersonallt y> being a determined product of the past predes- 
tines the future and that personality growth and development is ’restricted 

an^nfle^r^ by th / Stren9th 0f the past - Ma " would P be little Lre than 
an inflexible mass of organic matter, bound by what he has been with lit 

h ve C a"ta r s he Can beCMe - ‘ If «1* the case eSucatt™ wo Id 

nave a task of almost insurmountable magnitude 

crease man's capabilities. 



in trying to change or in- 



We should not go so far as to state that the past has no influence 
on the present or future for such a proposition is clearly inconsistent 





with behavioral evidence. The effect of the past is real and is strong, 
but the past does not have to be a sole determinant of the future. It 
is clear that in some individuals the links to the past are strong and 
may be deterministic of present or future behavior. But this is a siqn 
of personal immaturity. In fact there is some evidence to state that the 
more present motives are directed by the past, the less the maturity of 
•the individual and the less he has evolved from -early biological or child- 
ish states. In the mature individual the experience of the past guide 
current modes or styles of behavior in much the same way as any learned 
process affects the present. It is true that present motives may spring 
from the past and may have their origins historically in the past, but as 
current energy sources are not controlled by the past. They remain flexi- 
ble^ the demands of the present and driven by the satisfactions to be 
derived from future goal attainments. Finally, it may be well to quote 

again from All port concerning the functional autonomy of motives He 
says: 



"(1) ... motives are contemporary , that whatever drives must 
yi y e now, that the go of a motive is not bound f uncti onal 1 y 
uo its historical origins or to early goals, but to present 
goals only; (2) that the character of motives alters so radi- 
cally from infancy to maturity that we may speak of adult mo- 
tives as supplanting the motives of infancy; (3) that the 
maturity of personality is measured by the degree of functional 
autonomy its motives have achieved; even though in every per- 
sonality there are archaisms (infanti lisms, regressions* reflex 
responses), still the cultivated and socialized individuai^shows 
maturity to the extent that he has overcome early forms of mo- 
tivation; (4) that the differentiating course of learning 
(reflecting ever more diversified environmental influence), 
acting upon divergent temperaments and abilities, creates 
individualized motives," (1940, p.545). 

summar ^> what motivates behavior, does so now, in the present 
Behavior is not determined solely by the past, but rather has a basis’in 
the historical past, and is the product of the here and now as oriented 
toward the future. The acceptance of this kind of a theory of personality 
sets the tone for a dynamic educational process. It is not sufficient to 
throw up one s hands and state that "Johnny is just a product of his up- 
bringing and will never amount to anything." It is not only inconsistent 
withdynamic theories of personality, but it is pessimistic and could be 
detrimental to Johnny." Not only does this type of an approach to be- 
havior modification relate to the problem student, bit al^o to the non- 
problem, well-adjusted student. For now the whole world is open to him 
in vast dimensions. What needs to be done is to provide the right stimu- 
lation and the proper inputs into the personality system, and then watch 
the growth and development. Such a theory makes behavior modification 
real and possible as well asproviding a basis for developing motivation 
and shaping and changing attitudes in our students. The student need not 
be viewed as having come from an inflexible mold which will b^eak rather 
than bend in yielding to proper stimulation. 
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In summary, individuals have autonomy. Current behavior can func- 
tion with considerable freedom from the past, but a freedom influenced 
by previous learning and experience. To divorce oneself completely from 
the influence of the past is not only unrealistic but is sheer folly. On 
the other hand, to believe that all behavior is a function of the past is 
likewise unrealistic. For example, I may like to study art simply because 
I enjoy^it for itself: one may trace some origin in the past, e^£. , my 

parents' love of art, but this fact may not determine my studying art. 

The present satisfaction achieved is the motive and one need not go be- 
yond that fact to assess unconscious tension states that find relief in 
the pursuit of artistic study. The motive may be present and conscious 
in this case--one of simple aesthetic experience. 

With this dynamic basis of personality stated, we will proceed to 
develop the model further by discussing in some detail certain functions 
of or processes in personality as directly related to occupational edu- 
cation. We shall view them in terms of their value as concepts to the 
educational process and show how they concern us here. We shall look at 
three dimensions,- namely, attitudes, motives, and interests, all viewed 
from the occupational education perspective. 

ATTITUDES 

Attitudes may be defined as affective orientations to referents. 

This definition follows the work of Dr. Helen Peak of the University of 
Michigan (1955). What it means is simply that attitudes always pertain 
to some referent object, situation, place, or person. Attitudes do not 
existin isolation or in a vacuum. When we say that "his attitude is 
poor,' we mean that his attitude toward some specific or class of speci- 
fics is poor. The word affective in the definition denotes that there 
is feeling tone to attitudes; in fact, without the dimension of affect, 
there is no attitude. For example, a student may dislike a particular sub- 
ject such as graphics. He can be said to have a negative affective orien- 
tation to the referent graphics. We have not spelled out why he has such 
an attitude, how the attitude may manifest itself in behavior, or how the 
attitude may be changed. We have merely stated that his attitude is poor. 

The concept of attitude should be quite clear for it is encountered 
within ourselves daily and is manifest to ourselves in our interpersonal 
relations. In order to relate attitudes to our purpose here it is de- 
sirable to take a functional approach to the discussion, that is, one re- 
lated to the purposes attitudes serve. For this I wish to refer to the 
brilliant definitive work of Daniel Katz, also of the University of Michi- 
gan. Katz (1960) has shown that attitudes largely serve four basic func- 
tions, namely, an adjustive or utilitarian function, an ego-defensive func- 
tion, a value-expressive function and a knowledge function. When viewed 
from this approach, the purpose of attitudes becomes clear and the dynamics 
that evoke attitudes can be recognized with the process of change specified. 
It serves our purpose here to discuss this functional approach in some detail 
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from +h’I S ?H«i h +H a + J i!u 1:i U® utilitarian function of attitudes follows 
trom the idea that the development and maintenance of certain attitudes 

serve useful purposes to the individual. For example, it is of value to 
have a positive attitude toward occupational education for I find 
myself earning my living to a large extent from work in the field. If I 
c h ^L ne9a fi V S orie l ntatlon toward occupational education, my personality 
in ^rp a c° U l d be . racked Wlth dissonance created by the fact that I work 7 

wMrh T °VM? te I eSt ° r value t0 me * Thus 1 would manifest conflict 
which is unhealthy to the process of growth within myself. Another ex- 

cTnrp h 6late + 1° the st ^ dent who d °esn't like graphics mentioned above. 

a ^tp 6 nf S H takin9 graphl ^ s> but since he does not like graphics, he has 
a state of dissonance within himself. He will attempt to relieve this 

ssonance in many ways, ways largely determined by the strength of the 
distance which is a function of the unpleasantness of the negative af- 

tfnn\h + f y attem P t t0 re duce the dissonance through withdrawal by cut- 
g h t c J as s or getting ill on those days he has that class. He^ay 

dr P n °k thaX gr 1 aphlcs ls not instrumental to his reaching his de- 
sirec goals by not applying himself and not doing the expected work in 

dSnt C + UrSe H T part ' !cular styles of behavior are possible to this stu- 
dent to reduce his dissonance including belittling other students, the 

iuct^r* etc ' Ib should be clear now what is meant by the ad- 

justive or utilitarian function of an attitude. Such a unction is based 
upon the fact that most individuals develop attitudes to ' nv-imize satis- 

Denal ties° d ; nVlr 2 raient and diss.., section and 

utilitv n-F +h UC ^++^+ 1 ^ de i depend on P ast and present perceptions of the 
utility of the attitudinal referent. 

+ . Tb f n ! xt po j nt t0 be made is how to arouse such attitudes for posi- 
Jn thp ffeCt an ^ h0 V t0 Chan?e Such attitudes if they are not conducive 
S,.2St P ?r developme [; t °f .the individual , in our case the occupational 
minht h* T °. a ™ use such attitudes the teacher, or counselor, or whoever 
™ gh J b * ° inf ^ c \ u P° n the student has to activate relevant needs in 
sb ^ den J. S0 ^ hat the referent is perceived as good for or consistent 

De^eiJpd°,f Ctl H SS f thS StUdent ’ In ° Ur eXamp?e * ^aphics ba s to be 
?tndpnt d wh^ 9 °° d +H d neces f ar ^ t0 the career or to the objectives of the 
student, whatever they may be. This may imply ‘that it might even be nec- 

ess a ry to assist the student in modifying his objectives if graphics do 

Th! Il 9Ur ! 1 2 t0 bhe appropri ate objectives of this individual student. 

_ important point is, however, that he must perceive the utility of the 
course in graphics and not merely be told of its importance. If he is 

arce y fnrthpr f H^ S importanca without his actually perceiving its import- 
ance, further dissonance could be created and new negative defensive at- 
titudes develop to reinforce the former negative attitude. Should this 

fiVM?t t° °« sbude i; t » attitude change will necessarily be even more dif- 
ticult to effect. To change adjustive or utilitarian attitudes, it is 
necessary that the attitudes and their related behavior no longer pro- 
vide.the satisfaction they once did, or that the goals and objectives of 
the individual be raised to such. an extent that the attitudes do not serve 
a useiu. function. _ In the case of our student who hates graphics, it may 
be necessary to raise his vocational objectives in order for him to realize 
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the inadequacy of his negative attitude toward a subject critical to his 

achieving hi s^ew raised vocational objectives. . 0b ^ io ^^. p T u fS f^°- 
his negative behavior will not result in the desired change, but may 
ther strengthen the negative affect toward the course in 9£ a P r 

then the student not only cannot perceive the usefulness of the course, 
but he has threatening and harmful experiences associated with it. 

The second function that Katz ascribes to attitudes is referred to 
as the ego-defensi ve function. In this case the attitude arises from with- 
in the dividual and attaches itself to a convenient external referent. 
Within t, eadjustive function, the attitude arises from the external re- 
ferent d rectly Th erein is the essential difference between these first 
twc^functions; a difference that is critical to the arousal or change of 
such attitudes In the example of the defensive attitude the individual 
is attempting to protect (defend) himself from ac knowled 9,'"9,“ r *?'" 
about himself or certain external realities. It is a mechanism that allows 

the individual to live with himself more comfortably. 

fense mechanisms of projection, rationalization^ ove £" c !? t . 0ur etu _ 
on are good examples 0 f behavioral components ot such attitudes. Our -tu 

dent who hates graphics and therefore belittles it as a n ^ b i uniquely 
fuses to acknowledge its value to him may be doing so not J" J 
utilitarian sense as previously described, but ratner i 
He may know that graphics will demand more ski IT than he .] s *!?l e 2? 1 ° in 
vide. He may know of certain basic ability gaps within himself which will 
be manifested to himself and to others in the graphics course. Thus t 
problem is ^withi n himself in terms of certain ability weaknesses^nd^he 

attacks graphics i n a negative way, refusing to acknow g GraDh- 

and thereby defending his ego from failure in something important. Graph 
fcs therefore becomel ?he referent' of the negative attitude only because 
it is a convenient Outlet for building one's own defense^. 

It follows clearly that the mechanisms of defensive attitude arousal 
and change are different from those of the adjust! ve or utilitarian type 
of attitude In this case, Katz points out, the major mechanism of arousal 
is one of frustration. For our purposes it would be a rare case in which 

we would want to aro U se ego-defensive attitudes l n t i tv 
For the very nature 0 f such attitudes is to protect the ego from reality 
and flight from reality is hardly a worthwhile objective. More often, we 
mav want to change Such attitudes in order that our students may grow and 
acquire through learning experiences those things necessary to their e Lo- 
cational development. .Changing such defensive attitudes is diff 
deed, -for the development of stronger ego-defensiveness is a real possi 

bility. 

The basic mechanisms of such change involve removi f in- 

is causing the defensive attitude and helping the individual to acquire i 
siaht into his defense system. In the case of our graphics hater, again, 
oe?h^s the root of his problem lies in his inability to grasp one basic 
component of graphics It might be in his case, that postponing that course 
end P provlding for a makeup course in his area of inadequacy wi 1 remove the 
threat and thereby reduce the negative attitude toward the subject. When 
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the student realizes wfiy he hated graphics, he will be better equipped to 
handle similar problems in the future. Had no effort been made toward 
changing this defensive attitude with course failure resulting, the nega- 
tive attitudes of the student might have been heightened and he may have 
even dropped out rather than face taking the course over. 

The third function to be discussed here is called by Katz the value- 
expressive function. In this case the individual adopts attitudes con- 
sistent with his. personal value system and consonant with his self concept. 
Unlike the defensive attitudes which protect the ego from itself, the ex- 
pressive attitude manifests the ego to itself. The individual not only 
gives a clearer picture of himself to himself and to others, but he rein- 
forces values he cnerishes or wishes to be known. The current teenage 
craze for long hair may be expressive of a value of consistency with the 
peer group and independence from the adult world. It should be clear that ■ 
value-expressive attitudes are critical to sound mental health and maturity 
They are the mirror of the personality and serve most useful purposes. To 
the educator the expression of such attitudes ought to be viewed with keen 
interest, since they may help unravel the mystery of the behavior' of many 
students. In the case of our graphics hater, his dislike may be a reflec- 
tion of his distrust of authority, as reflected in his particular teacher 
whom he perceives as authoritarian. Viewing behavior in such a way, we 
can better appreciate its dynamics and importance to the person manifest- 
ing such behavior. 

There certainly may be alternative explanations of why our student 
hates graphics, but the important point to be made is that such behavior 
does not occur in a vacuum and the identification of and understanding of 
the personality dynamics at the core of- the behavior will go a long way to 
supporting the individual, rather than driving him further away from the 
educational objectives you know he should be aspiring toward. It may be 
very desirable to arouse such attitudes in our occupational students not 
only to evaluate the relevancy of the attitudes, but to use them as rein- 
forcements to behavior where possible. The use of appropriate cues will 
often e* ^ke behavioral expressions of the attitudes. For example, the 
announcement that henceforth all. male students in your school must not have 
long hair and must come to classes wearing a tie may evoke a whole range 
reactive attitudes expressing values of the teenage groups. Observing 
the differential reactions of students might go a long way toward exposing 
their internal dynamics. Another effective way to arouse such attitudes is 
through open discussions where students are allowed to express themselves 
on a wide range of topics, especially if the topics are viewed by them as 
controversial, e_,£. , the current Vietnam issue.. Arousal of value-expressive 
attitudes is really not difficult, though often very important or even cri- 
tical, since ~>uch attitudes express that uniqueness to which Allport re- 
ferred in his definition of personality. 

It is possible to change such attitudes and it may be often desirable 
to do -so in such cases as that of our graphics student. The key to change 
is that of creating, gently and carefully, within the student a discontent 
either with his self concept and its values or with his other attitudes if 



perceived as inappropriate to his true objectives. In reality, this is 
what education is largely all about. In occupational education as well, 
the student must be educated to function with a skill rather than merely 
to be trained in a skill. 

Finally the fourth of the functions to be discussed here is the knowl- 
edge function. Such attitudes find their dynamics in the need to under- 
stand, to know, to have order and clarity, to reconcile the self with the 
world. Such attitudes provide foundations upon which to build and func- 
tion; they provide standards or guides which promote a certain consistency 
to life. In the case where a student perceives a given course^ of study as 
providing a consistent framework upon which he can aspire to his career ob- 
jectives, positive affect will be associated with, the knowledge gained, not 
only in the utilitarian sense, but also for the sake of the knowledge it- 
self. The axiom that "truth is rewarding" is a good example of an expres- 
sion of positive affect associated with knowledge and truth. The basis of 
change of knowledge attitudes lies in creating again a discontent with the_ • 
current attitudes by providing new and more meaningful experiences. In tms 
way the person realizes the inconsistency of the old attitude- in terms of 
the new knowledge gained and thus modifies his attitudes to resolve the dis- 
content. Again the purpose of education in respect to changing such atti- 
tudes should be clea^: a genuine thirst for knowledge has to be created, 

but unfortunately there have not been enough thirsty students. 

We have spent considerable time identifying various attitude functions 
for our model which are likely to be present in our students and we have 
suggested general mechanisms for change. Butit would be naive for us to 
stop here. It is time to suggest some specific methods by which attitudes 
might be evaluated and change measured. Here I think we can look to indus- 
try for practical 'and efficient techniques. It would be ideal if each stu- 
dent could be analyzed in depth and a specific course of action detailed 
for him. This process would give us excellent measures of how effective 
we are being in promoting or changing attitudes in order that our graduates 
may be able to function not as trained robots, but as educated- human beings 
with specialized skills. Certainly I am not proposing that' in depth studies 
to assess change in attitudes of occupational students not be carried out 
where feasible. But such studies would require professional behavioral ex^ 
perts working in a detailed manner. If such is possible, it should comple- 
ment other less specific or more global techniques. But reality often dic- 
tates the use of less expensive and quicker methods. 

What I should like to propose is the creation of specific attitude in- 
struments for use in occupational programs. The purpose of such instruments 
would not only be to assess the individual progress of each student, but al- 
so to evaluate the total education effectiveness of the occupational pro- 
grams. Just as industry often takes periodic pulse readings of employees 
through attitude and morale surveys, so should occupational educators. The 
creation of a Vocational Morale Index is certainly within the realm of pos- 
sibility. The specific format of- such at, instrument could- be varied, but 
should be simple enough to be administered in groups and have sufficient 
reliability so as to be able to be used over again with the same students 



wh.n^tnLL" i ndex 0f Change - For exam P le > the 1'nstrument could be given 
allv »t \7? 1 pr09ram ’ And then at the midway point, and fin- 

t -I^ n a * ? e V™"' + If ? he measured attitudes have not changed or have 
taken a negative route, it would be clear that something is wronq. Now 
certainly the construction of such instruments would not be that^imple 
and would require considerable effort. But I can see no reason why the 

dpnPnH meni,S C ° U d n0t b ? devel °P ed - ’ lt is conceivable that many forms 

fa«S?I aoe°and^r am - el %°r, types i 9 e0 9 ra P hic Areas, socio-economic 
and experience of the students and so on would have to be 

developed if such a process were to be tried on a large scale But it is 

ful k6 data trae bha f for a 9 lven school such an instrument could provide use- 

le ors and^mf • ? P r° 9ram aaccesses or failures to the teachers, coun- 

Drovide a nnnd molh t i a i t0r? ‘ , Tbe c l assic book by Allen Edwards (1957) would 
provide a good methodologi cal foundation upon which to build such a Voca- 

tional Morale index . Not only, however, would the use of such an InstFUT 

n n J 0 Si r d V also n h»'Jh 9n l ! tiV r and J non - sl<1 ' 11 feedback of program success! but 
i! b the k ! y t0 understanding levels and natures of attitudes 

strument n^f-i Ca - eS ‘ , ? ata b ? sed upon da11 y observation coupled with in- 
atti tiiripc^ 0 l- 6 * cou l d P rovide the key to understanding the functions of 
attitudes as discussed above and shed insight into desired avenues of 
arousal or change as the case might be. avenues of 

imH Y V ? ry intere s tin 9 to note that in many of the training programs 

o?ie««ion ra Lain?nn r ? P - aimed tI the under P uall 'f^ d Adult, wo?ld of work 
orientation training is given. The expressed purpose of such traininq is 

!ene!al V l!° Pm ?h t ° f proper attitudes t°«Ard self, others, work and 1 i f 1 
generally The programs are often run on a knowledge basis, that is if 

!n over^f?- 6 bau 9ht what ought to be done, they will then do il!’ Such 

mtist S!wL ‘7 ° f abt ’ tu ? e ch A n 9e is frightening to the social sci- 

it ! hinhlS !rnb^i° e L n ? 1 mp 1 y a ct 1 “ °r change. As a matter o* fact, 
it IS highly probable that many of these underqualified adults will emerqe 

? nr attl ^ es because Attitudes will have been driven further down 
into the personality system and harder to recognize, but.no less potent. 

Jh 1S nece ^ sary t0 understand the function of certain attitudes be- 

a 2rL?n 9 a\n^PnJ\ S ^- + Ca H be tn ' ed * Wbat may work for one Individual with 
? nnf IhJ PP are, ? t attitude may not work for another, not only because it 

, 1 % Sam !- lndlV1 Ual ’ but also because the attitude may be serving a 

world f T Ctl0n , ? ltbin the P erson ality dynamic. The principle behind 
world of work orientation is excellent and perhaps would even have rele- 

° II ^ U ? atl ^ al P rograms in our secondary schools. But the current 
process used is often inappropriate to the desired outcomes. The use of 

rh-n o f - Se J S ^ 9 de y ice would 9 ive a basis Judging how much, if 
any, change is taking place. 

TnHov 1 ^]? s P99 est that the creation of a trial Vocational Morale 

In d e x be attempted by interested scholars and validated. It could be~a sim- 

hlpn^inn f 1°^ d + insig . hts valuable to program success. Industry has 
been using these techniques for years with considerable success. If such 

nA+?nn^i b H 1 n ] nd ^ s ^ ti y . as varied as it is, why is it not possible in occu- 
pational education? While it is not the purpose here to detail such a proc- 
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ess of i denti tying' and. measuri ng certain personality variables, it might 
be well to point out that the instruments could take on many varied forms 
including mul tipi e choice items, true-false statements, likes, dislikes, 
neutral items, agree-disagree sentences, rating scales, ranking procedures, 
other scaling techniques ranging from simple unidimensional models to multi- 
dimensional techniques, critical incident techniques, open ended question- 
naires, free associations, structured and scored interviews, etc. The realm 
of possibility for constructing specific attitude measures is extremely great 
and what is needed is a concentrated research activity related directly to 
this task. A simple review of the educational literature demonstrates a 
noticeable lack of discussion of techniques of attitude assessment speci- 
fically in occupational education. Yet the need is great, the difficulties 
surmountable, and the potential value great. It is through such measures 
leading to the continued and improved education of the. total man that occur 
pational education will more and more achieve its rightful and deserved role 
in the legitimate educational community. - 

MOTIVATION 

We have just discussed the nature and function of attitudes and sug- 
gested potential arousal, change, and measurement techniques. In this 
section we shall add' to our model the concept of motivation. Research on 
this topic is vast. For example, a recent book by Cofer and Appley (1964) 
entitled, Moti vation : Theory and Research , references over 2200 publica- 

tions related to motivation which is not a complete bibliography, but a 
selected one. It is also true that there are many varied theoretical ap- 
proaches to motivation depending upon whether one might have, for example, 
a psychoanalytic or an existential background, a learning theory or an 
hedonic background, and so on. Even within the general theoretical fields 
there are many related or divergent trends. Far be it from the purpose 
here to synthesize this more than half century of research and theory into 
a unified approach to be applied to the occupational education setting. 
Rather, from among the many human motives such as power, aggression, af- 
filiation, sex, fear, dependency, anxiety, achievement, etc. we shall sel- 
ect one which is of direct relatedness to occupational education. That 
motive is achievement. 

The empirical history of achievement motivation begins in the late 
1940's with the work of David McClelland and has been continued up to the 
present by many distinguished behavioral scientists. The latest major 
publication is entitled, Achievement Motives: Theory and Research , by 

Atkinson and Feather ( 1 966 ). McClelland (1955) took the position that 
motives are specific and that it is proper to isolate certain motives ana 
to study them in depth, much analogous to the study of attitudes. 

In order to establish an immediate reference point, I should like to 
define motivation in its broadest sense after the fashion of Atkinson (1958) 
as the arousal of a tendency to act to produce one or more effects. Such 
a definition avoids many theoretical controversies and is adequate for the 
purpose of this paper. Keeping within the ^framework of this generic defi- 
nition of motivation, we shall define the achievement motive (often referred 
■' l 
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to as nAch, or need for achievement) as a tendency to strive for success 
in situations involving an evaluation of one's performance in relation 
to some standards of excellence. 1 on 



* ~ B * fore we discuss achievement motivation in some detail, we should 

refer to one very popular theory of motivation which of late has been con- 
siderably applied to the world, of work setting. The theory is that of 

am ?he M ?h’° W (195 ^. w l! iCh haS been Ca 3 led a need hierarchy theory Basic- 
y the theory postulates that the satisfaction of one need is prepotent 

o e arousal of another need and that peed satisfaction is ordered in a 
hierarchy. The hierarchy from the lowest order needs to the highest order 
needs is (1) physiological, needs such as hunger and thirst; (2) safety ne-ds 

and rt CUnty ( A nd fear ° f the unknown » O) love needs such as affiliation 
:t ^ n i ( 4 ) esteem needs such as self-respect and respect from others 
(5) self-actualization needs such as self-fulfillment and total personal 

e ? Tre ;rJu S * hierarChy \ n °t abs ° lutel * fixed ’ but rStte/MSs for 
certain reversals in various situations. It is best to say that lower or- 

vati onaffitrenath^ 6 ^^ 59 '" 1 S v ed be ^ or | hi 9her order needs have genuine moti- 

* s St f i J ?QJJ? llCat i° n °! the theor y is ^levant to us here, 

. , ? as Maslow (1955) points out, a theory of growth motivation That 

it. behavior resulting from the arousal of such needf ls - go^-dnrfectCd and 
d -P° SeS ° ne t0 achleve hl 9 her order goals as lower order goals met It 
ratio? V6ry consistent with the McClelland theory of achievement moti- 

Maslow says: ' 

. " So S r as motivational status, is concerned, healthy people 
have sufficiently gratified their basic needs for safety, be- 
longingness, love, respect and self-esteem so that they are 
motivated primarily by trends to self-actualization (defined 
as ongoing actualization of potential capacities and talents, 
as fulfillment of mission or call or fate or vocation, as 
fuller knowledge of, and acceptance of the person's own in- 
trinsic nature, as an unceasing trend toward unity, inteqra- 
ti°n or synergy within the person) .(1955, p.8). 

Then in description of the self-actualized person’, he lists thirteen traits- 

o er Per ?3) ?nrTT ° f : 6al ^ ; < 2 > acceptance of self and 

otners, (3) increased spontaneity; (4) increased problem centerinq- (5) 

tone reaS 18) ^eat hKent: Jt increased autonomy; Wealthier eSal’ 
tone (8) greater probability of aesthetic experience; (9) increased 

nn S In Ct T W H th h r a " existence » O0) improved interpersonal relations; 

(1 ) more freedom of character; (12) better creativity; (13) heightened 
va ue system. It should be clear that a noble life goal is to achieve a 

has f thp t ^Inn at ' IO I l State * !° r ^ 1S th ^ 0u 9 h such a state that man genuinely 
has the autonomy to respond to. change. Is not this critical in our tech- Y 

nologicalage? Should we therefore not strive to provide an environment 

which assists our occupational students in aspiring toward self-actualiza- 

dln?; h Lfiv! Cr }terion of educational success the extent to which stu- 
dents behave in a self-actualizing manner? It i-s felt that in a discussion 
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related to motivation of occupational students some thought must be given 
to active growth motivation, that is, not only. to the process whereby our 
students are trained in a skill which may to a large extent be habitual 
in nature once mastered, but also to the process whereby our student in- 
tegrates\this skill into his personality- system -in such a way as to lead 
him one step further toward his full self-actualization. If we do not 
create an environment in which the student sees his educational process 
as a means to his self- fulfillment, we have short-changed him.. For when 
the environment changes, as it will in such a technologically based socie- . 
ty, the student must have the desire to grow with the changes and the au- 
tonomy to respond to the changes. The changing nature of the world of work - 
is so great that skills mastered today may be outmoded in a few short years. 

If the student does not have the capacity of continued and spontaneous growth, 
he will be worse off in the future rather than better off, 

Maslow's growth motivation theory must be appreciated by all of us in- 
volved in the educational process. Insofar as our programs do not predis- 
pose our students to growth, the programs fail and should be evaluated as 
failures. It is so easy to evaluate a program as a success merely because, 
all graduates obtained a good paying job within a short period of time af- 
ter graduation. Yet, such a program could be a phenomenal failure in the 
long run if our students emerge as rigid rather than flexible and as set 
rather than responsive to change. The importance of such non-cogni tive 
variables to- occupational education has never been greater. (The author 
wishes to refer you to a, very interesting article by C. K* Lipsman (1967) 
in a recent issue of Vocational Guidance Quarterly, in which the Maslow 
theory is related to vocational choi ce. ) 

Achievement motivation theory is entirely consistent with the Maslow : 
growth motivation theory. As stated above achievement moti vatic i is a 
tendency to strive for success in situations involving an evaluation of 
one's performance in relation to some standards bf excellence. Just as the 
pursuit of self-actualization tendencies needs to be fostered in our stu- 
dents so does the achievement motive. Perhaps onte essential difference re- 
lates to the notion that the process of self-actualization is a continuous 
process of a long rsmge nature, a disposition towa\rd which one strives but- 
does not necessarily accomplish at any given point\in time. On the other 
hand the achievement motive produces- states of immediate effect-. It pro- 
duces tendencies to succeed in tasks not only of a [long range nature but 
here and now, such as passing a course with good grades, or mastering a 
technique with as much perfection as possible. The achievement motive 
may be a route to and a means of self-actualization. 

The achievement motive also relates to the level of aspiration of a 
person, Lewin and his associates (1944) have adequately investigated this 
concept and should be referred to by all interested in the process of stu- 
dent growth. Cofer and Appley state: it would be argued that the 

history of someone who has high nAch must be one of competition with per- 
formance standards or one in which the individual was expected by himself 
to do things well," (1964, p.763). It is probably true that persons high 
in nAch also have realistically high levels of aspiration, but not so high 
as not to be achievable. It has been shown empirically, for example, that 
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?n+ P i^ !J- t J h l?!L? AC - have a tendency to select casks involving risk of 
Remediate difficulty and thereby allowing themselves to achieve the 
task goal and experience the resultant satisfaction. On the othe^ hand 
peopie low innAch select either high risk or low risk tasks. The for- 
mer does net lead to goal attainment, but rather to frustration and dis- 
couragement; the latter leads to goal attainment but with little or no 

reinfnrrp^th atlS ^ Cti ° n hl9h and low nsk task undertaking do not 

_p or Jf the acn1 evement motive, but instead lead to high anxiety or 

°+:f M ! tratl0n and 10 a stifled desire to excel. The point to be made is 

tion so r ^a- d the S nee l t0 de nurtured ™ respect to achievement motiva- 
10n sc u * at - ^hey- neither become overachievers and thereby frustrated or 

a T d th r eb * " 0t cballe "9 ed - f-wr 

qo a lofL’tol a healthy, though not threatening, competition will 
go a ong way to foste^ tne achievement motive. 

SD . c /i*" "TT ba T C is tne ett.1n.wnt of goals which will foster a re- 
!?*f; 5Th? ; h and •? eo «W att8 ’ n1r >9 more difficult goals. Certainly, 
t , with.u the realm of the occupational teacher to structure an en 
vircoment which allows the student’ to taste achievement ^ success at' 

SSTSSr^rfiT' N0th1ns breedS syccess ftfr than success. On 
t,,e other .land, if tne environment ^ structured so difficult as constant- 

y to frustrate the student, he will develop a state of anxiety which he 



must relieve. His choices are 



many, but 



4 n ^ , , . . - ~ — -■ w "’“-'j > iie will probably either drop out 

hp? h tne anxiety producing situation, or he will do barely enough to 
get by and will remain as distant as he can in his attempt to av™d the 
anxiety producing tasks. On the other hand, if goals a^e set that are 
too easy and are accomplished without challenge, the student may develop 
an exaggerated sense of ability only to be frustrated latir on the job 

Our task here is to shed some light on how to assess whether or not- 
our programs are making an impact in these areas. It is necessary to know 
what we are trying to assess. Atkinson and Feather (1966) state that there 
has been no real advance in the techniques of measuring differences fn th^ 

s1nCe u ’ 94S ' Ti ^ 8 McClelland's early work ap arlntTy 
liil t ? ds S dasic ' Hls approach to the measurement of achievement mo- 
t.vation is sound in theory but difficult in practice. The basic hypothe- 



lll band's method is that when needs exist strongly 

fhp V Will ho -C-. _ u_ ^ V 



they will be reflected in fantasy states 
very hungry, he daydreams of food or when 



in a person 



For example, when a person is 

fied, he dreams or sexual fulfillment. Thus if a person has a hiah need 
o, achievement, it should be reflected in his fantasy world McClelland 

indefoVnL^ f° SC ° re 3 hl ' 9h]y P rodect ^ e technique to obtain an 

Tha . test used is the Them atic Apperception 
jest 1 TAT) wmch is so widely familiar to many. Numerous empirical ev-- — 
dence supports the projective approach, A similar approach us^ng the iowa 

Jest IIPIT) has been tried with some success 
the case of IPIT, the ^-esxed subject selects one of four statements about 

TA? P R^th^’ aS °P posed t? free ^y discussing the picture as in the use of 

^7”the idmin?^^ 65 rSq ^ re thS USe ° f 3 hi9h1y tra1ned test technician 
. the administration and scoring. Such instruments are not practical on 

a mass scale to assess achievement motivation in our education programs. 
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o^ec^^rtest^ouil 3 ^ t r h\ C °ad.;an1age hl o^ea' n *"? " Ce ^ nly an 

seeing whe^as the coding of p-ojert^e o-oror- m s t-ation. and 
mo-e time and requires mo^e tracing," P 966 , ^351?.' ^achievement takes 

Before we go on to make some ^iqq^fnnc ■» - + - . + 
achievement moti vation that w< n b « -- e o ^ + measures of 

education, we should .-ew onp oth ~ ^. h ?. a hp ! + 4 ^ occu Pational 

w_j^ Persona! Preference ? c hed„ie i d test ' That test * s the Ed- 
n umber of personal needs wltfClKhe t"<’ te^hie-;""^*, s * ren 9 ths of a 

a-e ach-evement, deference, order etib- be n ?f ds measured 

traception, succo^n-e dorrr nan-p ’ f h b ~ ? T 3 ononi .y » a ' r f * 1 i ati on , -m- 
ance, hete'osexuaHt^,'and , 'agg'^cs-on' Tifet : ance > C«» 9 «, endur- 



sedation was abi~e to naui^hp* ' ' '' e T ' 1 966 ' 3 doctor! dis- 

gmee^ng techn 0 i 0 gv -n a co ? t ,e~ordar Gr V 9 ^ duat f s and dropouts ’n en- 

EPPS Those who graduated^scored's^n-’^* ^ant” v C hioh nS ^ , ^ U ^ e h l:,S * n ^ the 
'nnu+n - — i ~ ■9^t , j/ highe^ m ach i e vemen t 

r i . __ 



ati on 



than dropouts and "he "d-opouts -corp^T- 7 " ?a ~ ty highe-* in achiever 
and nu-tu-ance than the g-adua^e, 1 t ' T ' C3 + b y h ' gher ‘ in affi.- UL , 
some va^ue to v 0 cat i on a 1 ll!;! !- whe ’ Pp ? a " s th *t the EPPS may be of 
desi red and needs to be measured” h achievement mot-vat*on change is 



change , wh e -e we^uggested^ome' type™^* V V 9ed ? d t0 assess attitude 
1 ° n ed after indust-ia 1 te-hnmi JP /of ac - pc - 0,:a 1 ° nal morale index fash- 
t? a recent allele states that th^elrf^rt'wlvc^o 5 ’ McClelland ^ 955 ) 
ne fir St method involves ask^na the <ub e-t V J measure motivation, 
when he says; " ~ JDje^r a ip 0 rt- re^n forces this idea 



sv^vsrs. 

why we should not sta't our'-nitL*?-™ h f, n ° rea s°n 
us the answer as he sees the" 9 y a5 d n 9. h,m t0 tel 1 

can ten what they are try „g t0 do , p ' « 

degree of validity r 0 rt,f P i , t - e w^th a h'gh 

prevailing validity 0 t projective - "It -Cme^ts , ” V ng62, y^) 6 

se^ f- repor^fnven tories 1 ^^h^po^nt 8 ^ t6StS ’ and oth ^ 

^±£ : r 

bility and vali^tv to ^ Z Q * es y ° U Select fo " basons of relia- 
1964) warns, however that whin ^ St3te McC1e_n and (Cofer and Appley, 
approach one must d 1 ' sti naui ch h ^ asurin 9 achievement with this direct 
and value of achievement 9 /vAchh metres 6 ^°e ^h’evement -nieasunes (nAch) 
ure of the achievement motivation p-ocesi wh P LcTr i S actuall y the meas- 
of the conscious des^e to a rhievp P r*tL f It the latter th e measure 
are important with one serving t 0 -ein^-^fh th ^ S a " e dlfferent > but both 
that projective technique, a, h e US Js aZ LlJ ^ McClell and feels 
report questionnaires tend to mea^urp the r° Seared to nAch, whereas self- 
evidence supporting this hypothecation ,s “cUng"" * t0 achl ' eve ' Raal 
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I would like to suggest three approaches here that ought to be re- 
searched for their potential:, usefu i ness in assessing achievement motiva- 
CiOn change in occupational education. The first would be an instrument 
which has a series of task statements which the student is asked to rate 
in terms of, his perceived ability to perform the tasks realistical ly. 

Not only could such an instrument give am achievement level profile, 'but 
it could also give an index of over and underachievement which was dis- 
cussed above. It is suggested that the instrument be used in conjunction 
wich certain ability measures. The assessment of whether or not the stu- 
dent is prone to overachi evemen t or underachievement could be made by mat- 
ching his score on the motivation measure with his ability score. To my 
knowledge^ this approach is not in use in any area, especially not in oc- 
cupational education- The second possible direct measure I would suggest 
would be an instrument in which the student would rate a series of jobs 
on some occupational prestige scale. This measure could lead to an index 
of the level of occupational aspiration of the student. For example, if 
he rates a welder as high as he rates an engineering technician, he might 
aspire no higher than to a welding career. Such an instrument needs con- 
siderable developmental research and could prove to be of no value. Nev- 
ertheless, it is worthy of research, for if it could be made to work, it 
would not only give a motivational measure, but also might give some in- 
dex of occupati onal interest, a concept to be discussed later in this paper. 
In addition to serving. a twofold purpose, it would be extremely easy to ad- 
minister and would be objectively scored. The third direct approach I would 
like to suggest would be the construction of an attitude type instrument 
from which levels of achievement motivation might be inferred. Statements 
such as "luck is more important to success than ability" are the type of 
statement in mind- If the student strongly agrees with such a statement, 
it should be safe to infer a very low state of achievement motivation. Again 
much developmental work needs to be done, but it is worth the effort. The 
practical payoff could be great in terms of the benefits to occupational 
education. 

The second major method of measuring motivation suggested by McClelland 
(1965) is by asking others, that is, to have the subjects assessed on moti- 
vation by others. This technique is used in education, business and govern- 
ment for many purposes. It certainly could be made to work In the assessment 
of motivational change in occupational education. Here too research on re- 
liable assessment scales is suggested so that this technique might have the 
maximum power possible. Adequate research will help standardize techniques 
as well so that cross comparisons of programs can be used for whatever pur- 
pose needed. 

Finally the third general motivational measure is that of observing 
behavior. This technique is especially applicable to assessing achievement 
m ?^]* va ^ 10n ar) d its increase or decrease over time. There are many possi- 
bilities here and a few will be suggested. Sears (1957) suggests an ap- 
proach in which certain behavioral objectives are set for each person based 
upon his abilities, etc. Thereupon these critical behaviors are observed 
in an anecdotal fashion. Another suggestion would follow the critical in- 
cident technique used in the Armed Services and in business to assess be- 
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. cti-ripnt is observed involved in some 

havior, In this case wneneve - fh in such behavior can be ob- 

critical behavior, it ^ jecoj T f 9 t h e re appears to be significant 

served by comparing periods of ^me^ ach i ev ement over successive 

increase in critical behaviors relate. d tq i ac. ^ . g improye ment in the 

periods of time, it might be^nfe t ion A third behavioral ap- 

need for achievement or the -eve.s of a P ■ rtain assigned tasks and_ 
preach might simply be by t e 0 ^ e _ d It i s possible to have weights 

the manner in What in'effect is created Is a 

attached to levels of + ta ^ k . a ^r° m P ph ; iQr observed could be measured _ and 
behavioral sample test, u above there are many possibilities 

scored as to achievement As^tattu ato^ Tp ; factj McC ienand himself 

say si" "Wh.y'no^us^that'as "a ^s imp 1 e method of measuring motivation: how 

hard does the pupil work 7 " ( 1 965 , p o 

In summary, we have further enlarged w rn\s h the a acMevement 
tivation and viewed the growth tne y ^ c Htical importance motivation 
theory Of McClelland. We Ji|e S education and have suggested sev- 

devei opment in programs ot o~cupa oi nai e rpose 0 f evaluating program 

era! approaches to measuring motives fo the pu P and> if this be 

success „ It is ge/ferally held that motives ^ upatiQnal educa tion.; We 

the case, let them oe . f me-ely gave them a skill but did not 

would shortchange our students f we ^ J 9 pQwer and fexib^ity 

give them the force to execute .ne -n 
to adapt to change. 

VOCATIONAL INTERESTS 

The final personal ity dynamic to be | ^^“ded^our 

of vocational interests Guion ! n ?^se interests are motivating, for peo- 
ward activities and stated that nte t ^ relevance of vocational 

pie do things suggested by their ^^sts. s is als0 summed up in the 

interests and their relationship bo othe ° nterests indnC ate the direc- 

statement by Edward Strong: *n 9®^.’ h how far h e can. go; and his moti- 

«$£ st"i ck- to- -1 ti veness -n^cate ho„ 

he will go," ;x&S5t"PP , T 88- • 89 > - 

~ Unlike attitudes and -Ovation as 'rjUt yin 0 "' ’ 
the concept of vocational interes s h. that C an be added here.. To 
the technical literature and the 'f, ^ ^ mQre exte nsive than pos- 

summarize the vast literature would be at k f ■ without mention of 

sible here. However, this paper would not be “ P inhei - e „tly re- 

the concept, which is among those non cogn_ the most lucid an d compre- 

lated to occupational education. fQund 1n the c1a ssic work ot Donald 

hensive treatments of the |^ b 3 ADDraising Vocational Fitness. I 

Super and John CHtes (1962) ent tied. gEE— — fro lTthat book which 
the 1 i be^t^ of present nQ^ y jm . . c trurtij^^' 

sum up ?he dynamics’ of interests within the personality structu 

- . l 4 -^ A 
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and social evaluation on the other. Some of the things a 
person does well as a result of aptitudes bring him the satis- 
faction of mastery or the approval of his companions, and re- • 
suit in interests. Some of the things his associates do ap- 
peal to him and, through identification he patterns his act- 
ions and his interests after them; if he fits the pattern rea- 
sonably well, he remains in it, but if not, he must seek an- 
other identification and develop another self-concept and in- 
terest pattern . His needs and his mode of adjustment may 
cause him to seek certain satisfactions, but the means of 
achieving these satisfactions vary so much from one person. 

With one set of aptitudes and in one set of circumstances, 
to another person with other abilities and in another situ- 
ation, that the prediction of interest patterns from needs 
and from modes of adjustment is hardly possible. Because 
of the stability of the hereditary endowment and the rela- 
tive stability of the social environment in which any given 
person is reared, interest patLerns are generally rather 
stable; stability is further increased by the multiplicity 
of opportunities for try-outs, identification, and social ap- 
proval in the years before adolescence. By adolescence most 
young people in developed areas have had opportunities to ex- 
plore social, linguistic, mathematical, technical and business 
activities to some extent; they have sought to identify with 
: parents, other adults, and schoolmates, and have rejected some 

and accepted others of these identifications and the related 
social roles; self-concepts have begun to take a definite form. 

For these reasons interest patterns begin to crystallize by 
early adolescence, and the exploratory experiences of the 
adolescent years in most cases merely clarify and elaborate 
upon what has already begun to take shape. Some persons ex- 
perience significant changes during adolescence and early 
adulthood, but these are most often related to normal endocrine 
changes, and less often to changes in self-concept resulting 
from having attempted to live up to a mi si denti fi cati on and to 
fit into an i nappropri ate pattern, or to experiences which 
greatly broaden previously narrow horizons. Vocational inter- 
est patterns generally have a substantial degree of perman- 
ence at this stage; for most persons, adolescent exploration 
1S 41 n1 n9 t0 somethlng that is already there," (1962, 

It is generally agreed that interests are relatively stable, at least 
.y th e college years. Much longitudinal research over considerable per- 
iods of time confirms this stability. Since such stability does seem to 
exist, the concept of vocational interest should play a significant role 
in the process of occupational education. To the extent possible or de- 
sirable, students should be channeled into tracks at least parallel with 
their patterns of interest. It is fortunately true that many serious at- 
tempts at the. determination of vocational interests have been made in oc- 
cupational counseling through testing and related procedures. It is per- 
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haps appropriate to list in a summary fashion some of the more widely used 
measures of vocational interests. No attempts at serious evaluation will 
be made because of the wealth of published research and literature on the 
measurement of interests and on the specific instruments cited oelow. The 
list is by no means inclusive of all interest measures , but, rather, typi- 
fies those which have received considerable use. They are: 



] , A1 1 port-Vernon-Li ndzey Study of Values 

2. Brainard Occupational Preference Inventory 

3. California Occupational Interest Inventory 

4. Cardell Primary Business Interest Test 

5. Cleeton Vocational Interest Inventory 

6. Gregory Academic Interest Inventory 

7. Gui 1 ford-Shneidman-Zimmerman Interest Survey 

8. Kuder^ Preference Record 

9. Lee-Thorpe Occupational Interest Inventory 

10. Michigan Vocabulary Profile Test 

11. Minnesota Vocational Interest Inventory 

12. Pictoral Interest Inventory • 

13. Purdue Job Preference Survey 
14*. Rothwell -Miller Interest Blank 

15. Strong Vocational Interest Blank 

16. Thurstone Interest Schedule 



While we suggested several alternatives to the identification and 
measurement of attitudinal and motivational variables since there appear 
to be no adequate measures specifically related to occupational educa- 
tion, we offer here no new suggestions in terms of interest measures. 

The research has been prodigious and the development of measures contin- 
ues in many spheres. One of the latest of which, and very promising, is 
the newly issued Minnesota Vocational Interest Inventory , 

Vocational interest measures should be a part of every serious pro- 
gram of occupational education at the secondary and postsecondary level 
where young people are trying to mold themselves into careers consistent 
with, their personality dynamics. The use of such measures in skills up- 
grading or adult continuing education or other such occupational train- 
ing programs is far less meaningful and may indeed be rather inefficient 
and invalid for the purposes for which such programs are offered. Such 
is not true in the case of the young person aspiring toward a suitable 
vocational choice. Since there has been considerable success with in- 
terest measures, it seems that more widespread use should be made in or- 
der to achieve the educational efficiency that our times call for. Every 
effort should be made to reduce the trial and error approach to career 
choice- Such choice should be made as systematic as possible. This or- 
derly approach to occupational education will reduce duplication and make 
for an efficient educational process which can be more responsive to the 
students . 





SUMMARY AND CONCLUSIONS 



The purpose of this paper was to shed some light on certain oerson- 
; p ty !? r i ab I eS ln occu P atl ' onal education. It was* implied early in the 
nfhll IIl at l f cccu P atlonal education is to be accepted more widely by 

cunfltinnL'i Ca J° rS and th f publlc as true education and not merely as oc- 
„ H Ra H° nal trainin 9» i must achieve greater acceptance into the total 
educational community. One way for such acceptance is through the con- 
stant search for ways to improve its relatedness to the total man In 

educltion th U mUS ! be ^Pt clear that there is far more to occupat onal 
education than merely imparting a skill. The total personality sv.tem 

must be prepared and equipped to handle the new skill so that the^erson 

a nIrlon%h the of 1m P arted » is one thing to^We 

on the psycho-motor habit patterns to perform a task of a given oc- 

of P a DpIrqnn U + S 9U1 ^ e an °ther thing to make a productive worker out 
of a person Most people can achieve basic job skills, but far fewer can 

QraSrm^Plv C ; ent h WOrkerS ^ InS ° far aS formal occupational education pro- 
grams merely teach a person an isolated skill rather than a method of 

?s 1 the 1 obiPcti l1 ' self ‘ fulfillment and productive output (when this 

qrams are L Tv J nf ^ Pr ° 9 T fa11 - Fortunately, fewer and fewer pro- 
grams are guilty of^this inadequacy. Certainly there is a place for mere- 
ly J™ Rartl " 9 skllls 1nt0 those who may simply want a new skill, but in 
enough? Wh6r6 9 Career 15 belng molded » imparting skills is far from 

We have attempted to build a conceptual model as a basis for meas- 
indic->tPH S th allt + changes associated with occupational education. We 

? ature of P ers onal i ty as dynamic, rooted only historically 
m the past but oriented toward the future. We then proceeded to the 
nature and functions attitudes play in this dynamic personality system 

that S sectinn d h WayS t0 arouSe and chan 9 e these attitudes. We concluded 
U d l c y suggesting a Vocational Morale Index as a measure of at- 

concpnt lot, d t Chan9 ^ ln occupational programs. Then we turned to the 
t?on aL nnp r?f Va ^ 0n summarized two . teories, one of growth motiva- 

ina mo??v^?nn i i ieVem ! nt u m ° tlVati0n ’ Several ideas related? to measur- 
msHP nf le ve s and change were presented. Finally some mention was 

made of vocational interests and their measurement. 

- ls concluded that genuine effort must be made in respect to the 
identification an d measurement of non-cognitive and non-skill aspects 

Crement Pa i?n? n ? edu F atlorK Real P ro 9ress has been made in interest meas- 
measurement fa F less Progress has been made in attitude and motivation 

° position is taken that without greater concern for these 

inn t anHV° CCUPatl0 [! al educat1on wi 1 1 be percei ved at best as merely train- 
tiona? d process? 6r h ° P6 t0 931 ° greater acceptance as a legitimate educa- 

- objective of occupational education must be more than simply pro- 
ducing bodies equipped with a salable skill. In the words of Atkinson and 
Feather (1965) we must create achievement oriented personalities who will 
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be responsive, to ' growth and the the’ challenges of growth 

person may function efficiently . .. - rpaui red this same person who 

ere not demanding. But when pi as t city s ^e<, f is the P seeds Qf 

stands still falls behind. Thus the rigid gra of economic 

achievement are not planted will 9 nhenomenal force that even 

life. Our technology 15 .exploding with such f"f *'J° eness t0 chan g- 

the person who has the capability 9 what then will happen to 

ing demands is often prone to be oveivhelned . What then^il ^PP The 

the occupational student who may ® c . f persona iity variables is para- 
need to evaluate our programs on the level ^ persona, jr ^ ^ rye a$ a 

mount. It is hoped that the m o.® P£ and measurement of these variables 
basis for research in the identification and "^“ecentl y contributed an 
which are so critical to program success. Gross recent y ticle was an 

nessing the^ecessi ty%or S?nSE* ^ s^Vfitting close to 
this paper: 

■I tn enable a person to grow into a style of life that in- 
rl n dp s learninq to live in a community and to change from on 

disturbs his occupational career so rudely, (1967, p.422). 
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PROGRAM PLANNING AND EVALUATION 



Perfecting planning; program budgeting and systems analysis in the 
federal agencies grew out of the President's directive of 1965. 

The resulting effort on the part of many federal agencies has car- 
ried over and influenced State and local governments 

The application of systems development by industrial organizations 
has been prof - ! t-ori ented The application of systems development to gov- 
ernment services has been service-oriented and thereby striving to pro- 
vi de the best possible comb ination of se rvi ces with limi ted re so u rces , 

We who are dedicated to occupational education strive for effective- 
ness by providing for people the proper programs and for efficiency by 
doing them wel 1 . 



My remarks will focus on planning and systems analysis pertaining to 
vocational education. We are concerned with the present status of proarams 
and evidence of program results. We are concerned with how to present~a 
continuous flow of evidence in a most acceptable manner. 

Many of us know that each one here and the organization you represent 
can be a^powerful force in perfecting public vocational education. While 
our country leads the world in volume of education, certain imbalances 
must be adjus ted--the incidence of unemployment, dropout, delinquency, 
and inequality of education, Increasi ngly , these imbalances have caused 
us to look critically upon traditional metnods of providing educational 
services that do not fully allow for those significant primary factors 
which affect the education of the individual. 

Expectation is growing that modern concepts of education will be fully 
applied. TLase concepts encompass the total education of each individual 
as he grows and matures in American society. 

ELEMENTS OF PLANNING 

With increasing expectation of more effective delivery of education- 
al services, systematic planning is demanded for a mo^e accurate balance 
of programs in response to people and in consideration of available re- 
sources. This planning concerns itself with comprehensive vocational edu- 
cation which consists of three divisions of activity: (1) the effort dir- 

ected toward initial educational development — that is, those efforts nec- 
essary to adjust each individual to a useful occupational and social role 
in American society; (2) i wfa . r: ng the education provided from time to 
time as necessary to help each inci vidua! remain productive and adjusted 
toward the American social system; and (3) continuing education directed 
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to all individuals who may benefit from It vocationally as they mature in 
the American society. 

Many educational institutions do not they, role a S comp and"state 

^ Sirs ctkm- 

alternative ways of carrying out program^ J h ®’^ plan and budget 

in S terms^of^objec^an^acti vi ty , andfo evaluate in teAs of effort expended. 
Mr. Armstrong warned against evaluation of process. 

One encounters planning in * ’ 

each occupational *^r est .1 n ' "management by objective,' 1 or "pro- 

mi n Trial increase. 1 he receni inie . , f. nrmr|in1 * +i es to conduct broad 

gram packaging' 1 has encouraged State and local cowun^e^tp cC Mode , 

planning activities to reduce educa^o - • f- nan -e projects . Planning 

Cities, Cooperative Health planning, 5x5x5 S f^ P n1z J aticls which 

Sf occupatio al education Such 

of agencies^organi zati ons "and^ystemsf both educational and non-educational ) 
Shich S?e Essential to effectively deMver educational service. , 

tssr •sras?; as, 

most recent expectations? 

ter or -other means. he mission sper .es z ne a De rforms and defines 

f i^n ™ a -f he 

vocati onafeducation W i s'^to^pr^tde throughout the nation readi ly 

to 

enter and advance in the Nation's labor force. 



Goals are established by 



i s 



a lo.ng- 
- 1 i rected 



^he organization’s leaders. A gaal 
range 'specified statement of accomplishment toward which Programs en-e 
It may be as ambitious or idealistic as good udgment dicta e-.but^it ft 

stated"? p 1 terms ^"of the^cSrrenl availability of^resources^al though^t must^_^ 
State d and°Federal "agencies 3 respciisib^e 6 ^^ overall comprehensive planning. 

We should strive -'or considerable uniform 1 ty. Operat »d® n =’“ 
oroanizations covered, vy overall comprenensi P . w m ? ss i on -, these 

the t path ofSSi.v^t of the goal, 
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An example of a program goal in vocational education is: to maintain 

and improve existing programs and develop new programs of vocational edu- 
cation directed toward persons with special needs at the secondary level. 

An objective is stated in terms of achieving a measured amount of 
progress towards a goal or maintaining a certain measured level of edu- 
cation required by a goal during a specified interval of time. 

An example of an objective for a State is: given tenth-grade stu- 

dents who are three years below average in reading level, to provide re- 
medial reading, occupational education and placement for employment' for 
70 percent of the target group (10,000) at the end of the twelfth grade, 
at an estimated cost of $2,000 per student and ultimately reaching a tar- 
get group of 50,000 students a year in five years. These are the begin- 
ning specifications of a comprehensive educational plan. 

/ 

The mission, goal and objectives must be comprehensive in terms of 
geographical and population coverage. In addition, a plan should- repre- 
sent comprehensive plans of action for all agencies involved in mitigat- 
ing all causes of occupational educational deficiencies. The plan should 
be constructed under the general framework of a goal which is stated in 
terms of educational status- Additionally, the plan which states the 
educational problems, their causes and related factors should also con- 
tain educational objectives quantified in terms of expected terminal oe- 
haviors in a specified time. 

Operational educational objectives should be supported by . curri cul urn 
objectives, which are stated in quantified terms and directed toward amel- 
iorating specific educational deficiencies over similar time projections. 
Thus the plan must specify in quantified terms those activities which are 
to be carried out by the specified agencies, or persons who will accomplish 
the curriculum objectives which, in turn, support the operational objec- 
tives in ultimate terminal experiences of the students served. The pro- 
jected activities or plans of action are the heart of comprehensive edu- 
cational planning. They constitute the blueprint for action, the commit- 
ment to do something calculated to help attain the desired educational 
status. These plans of action canno" - be limited-to classical educational 
activity but must encompass activities of other agencies which have re- 
sponsibilities and authority for certain educational program areas; for 
example: socioeconomic conditions, health, housing conditions, working 

conditions and work opportunities are all factors which may adversely af- 
fect educational status, but which are- not within the direct purview of 
official educational agencies. Thus, comprehensive educational planning 
must consider plans of action to be carried out by agencies which are not 
educational but which ?re directed toward these factors. This points to 
operations analysis. 

OPERATIONS ANALYSIS 

Operations analysis provides information not decisions. Analysis 
makes appropri ate- materi al available to decision-makers; and if decision- 
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makers will not use it, then the operations analysis cannot be effective. 
Decision-makers must be taught the use and import of operations an ly- 

sis As I petitioned the RCU Directors, I petition you to find ways t 
fectively influence deci si on-mak.ers , if you are not now doing so. 

ZVrtflVp the data presented is ' 
meaningful and correct,. We should not develop analysis’" • vacuum, and 
we should describe realistic expectations as a resul y 

Maintaining and expanding a program of pub 1'ic vocational ed ^ a ^°" 
depends greatly upon the proper uMIJzation of reliable souths, of d|ta 
and the sophisticated analysis of these data and consideration of the 
other vocational education activities which are availaDle. ^ many pub 
lir nr Dr^vate organizations the program goals, the program objectives and 
the budget are expressions of purpose and programs Jience the^ r preciseness 
may be a refUcliSn of past performance including both successes and f a! 1 - 

urds.. 

Many decisions must be made at many levels; they must t ^ t V n? W bal anc- 
best choices among several alternative programs in the pxcpd- 

inn needs against resources. It would be fair to say that with the excep- 
tion of planning for the erecting of buildings, most program d ^ S Q° n p res _ 
been confined to meeting immediate needs and planning for the s p r f 

ently available resources. Our task is being expanded to that of 

more accurately predicting needed programs and necessary ^sources tor 
several years in advance. Considerable evidence s.iows that too narrow a 
focus on the immediate present and too much reliance ° n J h ® P , , d 1irr y t 
of admi ni strati on -and operation restricts the utilization of data and limit 
imaginative assumptions too early in the formulation of many P^ans^ J 
hot know what structural changes will occur in administration or the amoun 
of resources devoted by the several levels of governm^t to meet t There 
of the student population to be served through vocational-education. There 
?nre the focus should be on what needs to be done to and for people who 
will 'fill occupational roles. We must focus on what is right an no wor 
ry so much about who is right. 

Usually a considerable amount of confusion surrounds inner-” 

vity oefore it receives definitive attention, such as t e 
city disadvantaged youth and health care. Individuals with 
exDerience will need sensitivity in order -to. state problems .n a manner 
which defines them sufficiently to suggest methods of action. .Confus^o^ 
m3U result wSien conditions change from normal or static, Abnorma _ 

on society may bring problems into sharp focus. Imagina- 
tion, the ability to perceive problems and knowledge of problem areas are 
required before one may begin to solve them. 
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Changing value systems bring into focus dormant problems which other- 
wise might have been ignored. Observations may be of many kinds. Facts 
and values are usually combined in a creative process before serious con- 
sideration is given to the solution of problems or until they achieve 
priority attention. Postulates are sorted out and combined into theories 
from which assumptions are ultimately derived. Seldom are all facets of 
a problem entirely new or unique. New observations combined with old prac- 
tices may turn up new probabilities of solutions. Expertise is necessary 
to frame goals and measurable objectives. 

People like yourselves and those you may train can possess 
^ 1 ' s necessar y doing high quality systems analysis. Intellec- 

tual honesty must be maintained as program plans are developed and alter- 
natives presented. Decisions involve selection of the best alternatives 
from many possible choices. Decisions are made on the basis of combined 
facts and values. Facts may be misleading ^ince they are often derived 
from accepted practices and beliefs which may no longer be valid. One 
example of an accepted belief was the saying, "Everything that goes up 
comes down, and space exploration has blown that formerly accepted be- 
lief. The same may be true for many of the accepted educational beliefs. 

Values are usually derived from accepted and individual practices. 

The validity of the combination of facts and values leads to acceptance 
or rejection of this combination when it is presented at the proper time 
in acceptable language by the right individual to the ultimate decision- 
makers. Modern management demands that alternatives be prepared and ac- 
companied by hypothetical results, both desirable and undesirable. Other- 
wise, a course of action may be relatively -meaningless. Action taken on\ 
this basis creates an image of the reliability of the organization or of \ 
the individuals taking the action. Whether recognized or not, action is 
taken on the_continuum of uncertainty and, most approp^i ately , from the 
position of certainty. It must be our desire as planning evaluation and 
, r esearch specialists to strengthen the hand of the decision-makers. 

PROGRAM EVALUATION 

A point I have not touched upon until now is program evaluation. The 
planning process is obviously not complete without a specific plan for evalu- 
ation.^ As noted previously, the criteria for setting objectives and plans 
of action require that they be measured. Program evaluation is a process of 
determining the extent to which specific objectives and predetermi ned levels 
o. operation are attained. Management uses program evaluation to insure that 
intentions are actually realized and that the desired effect is achieved. 
Evaluation is not a simple task nor an easy one. Many difficulties are en- 
countered, ihe basic responsibility of e/aluation is the appraisal of ser- 
vices in terms of their impact on the problems of the people that vocation- 
al education is intended to serve. In spite of many difficulties, the evalu- 
ation process must be oerformed. Without it, no plan of action can be valid 
and reasonably expected to be carried out successfully. Evaluation is thus 
used in ail phases of program planning and program operator, it represents 
a feedback mechanism that consistently provides information necessary for the 
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appraisal of any phase of the operational process. It reduces the gap be- 
tween foresight and hindsight. The group assembled here is well qualifier 
to select the method or methods to be used for evaluation of educational 
services. , 

The uniform development and use of a basic information system will 
faci 1 itate eval uation of program progress at any time interval and help 
to establish the cause and effect relationships. 

I hope that I have given you an overview of a task that we are all 
dedicated to accomplish. I would like to make a couple of statements which 
will further reinforce what I have tried to present. 

Joe Hall of Miami said, "One thing we all know is that change will come 
whether we plan for it or not, but the piecemeal approach of the past will 
no longer provide the kinds of solutions our schools need today. We can no 
longer move from one prograim to another in linear fashion, cutting an uncer- 
tain path as we go. We must have a clear idea of the ultimate destination 
of all of our programs in education and we must map our itinerary with the 
utmost care and precision." 

Simply stated, this means that educational leaders must give attention 
to the process by which changes are made as well as to the changes themselves 
We need to bring more systems design to educational planning. This is noth- 
ing new, really. We live in an era of systems — systems arnlysis, systems 
management, systems engineering. Systems designee research is transforming 
the structure of American industry and technology. Systems strategy applied 
to education would help us look at problems more cojnprehensi vely to define 
mission, goals, and objectives more clearly, and to plan and evaluate pro-- ' 
grams much more effectively than ever before. 

Fishman of Colorado stated, "Industry and government are looking to 
vocational education, asking why the job of providing skilled manpower has 
not been done. They will not consider the fact that vocational education 
has for many years been playing second fiddle to college preparatory ori- 
ented programs, but take the point of view that a great deal of money is 
now being spent on vocational education." 

We have and will have, increasingly so, serious competition for re- 
sources. Alice Rivlin, Assistant Secretary -for Planning, of the Depart- 
ment of Health, Education and Welfare commented recently, concerning in- 
formation to support budget, "For some programs we had good information. 

For others we had less good, and vocational education., as the Advisory 
Commission has pointed out, was one of the weak areas. It's very hard at 
the national level to see what the money is being spent: for, what are the 
characteristics of the students and what is happening 7 to them. We've 
learnec ~hat hard information or, the effectiveness of Federal programs is 
very hard to come by. This is true of vocational education, but it is true 
of almost everything else. There's nothing very special abc ut vocational 
education in this regard." 

! 




I have not mentioned cost/benefit, but it's in the picture. It's 
going to be a very long time before the cost/benefit analysis can have 
anything useful to say about big decisions. This is not to^dis count im- 
port and usefulness of cost/benefit. There are a number of reasons; -one 
is that the benefits are difficult to measure. We really need more work 
on smaller decisions--the decisions of how to run a particular program bet- 
ter and how to gain the proper balance of programs in response to labor 
force requirements and the requirements of people. 

./ I will enumerate a few other factors that are believed to be of cri- 
tical importance, but I will not elaborate upon them. They are the sev- 
eral groups served through public information about vocational education; 
models for planning; Federal, State and’ local relationships; and the uni- 
formity of terminology. 

Is it impossible to develop uniform mission, goal, and objective state- 
ments, and uniform Evaluation, without utilizing a uniform terminology? We 
believe that "Standard Terminology for Local and State School Systems" will 
be a great aid in establishing uniform terminology. This has been developed 
by the U. S. Office of Education's Terminology Compatibility Branch, Divi- 
sion of Statistical Operations. The Taxonomy of Occupational Titles and In- 
structional Programs , devel oped by the Division of Vocational and Technical” 
Education in cooperation with the Department of Labor, should also be use- 
ful in forming a data base in planning, evaluation and reporting. I believe 
it would be difficult to overstress the important contributions this group 
can make to State vocational education planning and evaluation. 

Immense amounts of information are needed for establishing vocational 
program projections. Information may be provided by surveys or, in many 
cases, by syntheses of available 'statistical and qual i tati ve data. But re- 
gardless of the types of evaluative strategies or evaluative studies con- 
ducted or the methodology utilized, studies should be initiated in connec- 
tion with or after consultation with the State Directors of Vocational Edu- 
cation or their designated planning officers. Research on Evaluation car- 
ried out independently because of individual interests should be relegated 
to a very low priority. The idea of research on Evaluation being independent 
of program operati on in this particular arena of activity does not seem to 
be appropriate. All that is said about program planning and information 
systems is not to imply that these will do the. decision-making, but that 
they will increase the capability of the decision-makers at the various lev- 
els of activity in local, State and Federal programs. 
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Sunday, May 5, 1968 



7:00 p.m. 
8:00 p.m. 



8:00 a. m. 
9:00 a.m. 



1 : 30 p.m. 



Reci strati on 

Reception. Hayes Barton Room 

Monday. May 6. 1968 - Board Room 

JOHN K. COSTER, Presiding 



the Seminar" 

"Identification and Measurement of Student uutpu- 
Variables 1 ' CHARLES M. ARMSTRONG 



Recess 

Small. Group Discussion 
Analysis and Synthesis 



Lunch- 



"Selected 

Education 



Non-Cognitive Correlates 
" JOSEPH E. CHAMPAGNE 



in Occupational 



Recess 

Small Group Discussion 
Analysis and Synthesis 



9:00 a.m. 



12:00 noon 
12:30 p.m. 



2:30 p.m. 



Tuesday. May 7 - 1968. Board Room 

HAROLD STARR, Presiding 

"Measurement and Appraisal of Competencies 
WILLIAM R. GRIEVE 



Recess 



Small Group Discussion 
Analysis and Synthesis 

Adjourn to North Carolina 



State University Faculty Club 



Luncheon 

"Program Planning and Evaluation OTTO P. 
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CHARLES H. ROGERS, In Charge 
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GLENN Z. STEVENS, Presiding 
Professor of Agricultural Education 
Pennsylvania State University, University Park 
Member, AVA Research Committee 
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analysis and Synthesis 
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1:30 p.m. Participants' Reports of Research Projects Related to 
Eval uation 



Thursday, May 9, 1968, Board Room 

T. CARL BROWN, Presiding 
Supervisor of Distributive Education 
North Carolina State Department of Educa- 
tion, Raleigh 

Vice-President for Distributive Education 
American Vocational Association 
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Friday, May IQ, 1968, Board Room 
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9:00 a.m. Continuation of Workshop Session 

Reports by Workshop Chairmen 
Reactions by Consultants 
"Evaluation of Seminar" 
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